-- Logs begin at Thu 2021-11-18 17:40:29 UTC, end at Thu 2021-11-18 18:39:56 UTC. -- Nov 18 18:13:17.088936 dv-cinder-787764-6-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 18 18:13:19.826744 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.common.config [-] Logging enabled! Nov 18 18:13:19.827297 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev211 Nov 18 18:13:19.827520 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102545) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 18 18:13:19.831003 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.common.config [-] Logging enabled! Nov 18 18:13:19.831258 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev211 Nov 18 18:13:19.831570 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102545) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 18 18:13:19.832528 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 18 18:13:19.832764 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 18 18:13:19.833127 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 18 18:13:19.833375 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 18 18:13:19.833604 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 18 18:13:19.833922 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.834338 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 18 18:13:19.834648 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.834943 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.835235 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.835529 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.835995 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.836133 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.836421 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.836719 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.837027 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.837306 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.837587 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.837876 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.838157 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.838455 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.838726 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.839012 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] debug = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.839290 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.839711 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.840146 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.840427 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.840714 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.840993 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.841265 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.841539 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.841819 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.842144 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] host = dv-cinder-787764-6-iscsi {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.842421 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.842706 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.842993 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.843276 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.843550 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.843826 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.844129 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.844407 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.844677 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] log_file = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.844952 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.845236 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.845520 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.845807 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.846034 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.846256 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.846551 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.846839 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.847114 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.847389 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.847662 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.847945 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.848231 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.848502 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.848787 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.849075 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.849359 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.849633 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.849907 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.850179 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.850452 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.850736 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.851007 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.851278 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.851549 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.851859 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.852128 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.852403 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.852724 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.853007 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.853288 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.853571 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.853844 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.854123 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.854394 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.854666 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.854938 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] use_json = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.855209 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.855478 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.855758 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.856056 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.856327 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.856598 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.856867 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.857147 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:19.857441 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.857736 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.858035 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.858318 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.858618 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.858900 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.859186 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.859461 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.859747 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.860052 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.860339 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.860618 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.860906 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.861183 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.861475 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.861778 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.862071 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.862360 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.862634 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.862909 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.863198 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.863459 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.863742 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.864044 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.864334 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.864622 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.864901 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.865185 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.865478 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.865764 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.866035 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.866312 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.866600 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.866877 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.867148 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.867425 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.867710 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.868006 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.868810 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.869092 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.869373 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.869643 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.869912 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.870187 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.870471 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.870748 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.871018 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.871286 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.871561 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.871828 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.872137 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.872414 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.872681 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.872950 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.873223 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.873491 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.873763 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.874037 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.874304 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.874578 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.874849 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.875117 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.875387 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.875657 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.875942 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.876217 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.876486 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.876763 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.877034 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.877304 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.877572 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.877844 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.878113 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.878395 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.878689 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.878969 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.879245 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.879529 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.879806 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.880114 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.880391 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.880665 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.880941 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.881211 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.881496 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.881778 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.882065 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.882347 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.882628 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.882943 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.883222 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.883505 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.883780 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.884693 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.884982 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.885270 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.885565 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.885859 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.886154 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.886447 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.886740 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.887020 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.887331 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.887613 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:19.887832 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 18 18:13:19.888097 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102545) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 18 18:13:20.317266 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 18 18:13:20.317544 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 18 18:13:20.317853 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 18 18:13:20.318184 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 18 18:13:20.638810 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.639093 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.639372 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.640576 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.640853 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.641118 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.677192 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.677468 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.677739 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.692872 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.693154 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.693425 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.722558 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.722841 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.723114 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.761311 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.761311 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:20.761586 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.006439 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.007065 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.007065 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.007239 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.007981 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.107477 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.107799 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.108107 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.108382 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.108649 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.108961 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.109220 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.109475 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.109730 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.110011 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.110270 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.110533 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.110789 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.111041 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.111295 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.111557 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.111811 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.112098 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.112368 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.112626 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.112974 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.113234 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.113518 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.113895 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.114146 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.114392 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.114785 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102545) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 18:13:21.115026 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102545) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 18:13:21.115265 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102545) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 18:13:21.115500 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102545) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 18:13:21.115733 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102545) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 18:13:21.115992 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102545) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 18:13:21.116353 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 18 18:13:21.120017 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 18 18:13:21.124065 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 18 18:13:21.127768 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(1300, 1349)])]) Nov 18 18:13:21.129421 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 18 18:13:21.129883 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 18 18:13:21.130217 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 18 18:13:21.130591 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 18 18:13:21.133565 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 18 18:13:21.133814 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 18 18:13:21.134711 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 18 18:13:21.139991 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 18 18:13:21.164016 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 18 18:13:21.164472 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.164772 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102545) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:89}} Nov 18 18:13:21.165156 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.166731 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102545) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 18 18:13:21.167017 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 18 18:13:21.167264 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 18 18:13:21.170500 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.170783 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.233370 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 18 18:13:21.233608 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 18 18:13:21.233845 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 18 18:13:21.234206 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 18 18:13:21.254434 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_db.sqlalchemy.engines [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 18 18:13:21.792227 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Initializing driver for type 'gre' Nov 18 18:13:21.792752 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] gre ID ranges: [(1, 1000)] Nov 18 18:13:21.849453 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Initializing driver for type 'local' Nov 18 18:13:21.849784 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Initializing driver for type 'vlan' Nov 18 18:13:21.863174 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] VlanTypeDriver initialization complete Nov 18 18:13:21.863507 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Initializing driver for type 'vxlan' Nov 18 18:13:21.864019 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] vxlan ID ranges: [(1, 1000)] Nov 18 18:13:21.916590 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Initializing extension driver 'port_security' Nov 18 18:13:21.916942 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.extensions.port_security [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] PortSecurityExtensionDriver initialization complete Nov 18 18:13:21.917348 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Initializing mechanism driver 'openvswitch' Nov 18 18:13:21.917726 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Initializing mechanism driver 'hyperv' Nov 18 18:13:21.924712 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.plugins.ml2.plugin [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:13:21.925549 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > port after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.925929 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > port after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.926292 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > port after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.926836 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102545) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 18 18:13:21.927276 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > subnet after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.927643 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > subnet after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.928025 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.928449 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102545) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 18 18:13:21.928878 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > network after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.929241 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > network after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.929610 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > network after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.930098 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102545) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 18 18:13:21.930526 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > security_group after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.931399 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > security_group after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.931751 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > security_group after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.932223 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102545) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 18 18:13:21.932653 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.933014 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.933365 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.933784 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102545) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 18 18:13:21.934197 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > address_group after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.934552 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > address_group after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.934913 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > address_group after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.935335 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102545) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 18 18:13:21.935726 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] ML2 OVO RPC backend initialized. {{(pid=102545) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 18 18:13:21.936463 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.936828 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.937251 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > network before_response 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.937609 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > networks before_response 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.937966 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > port before_response 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.938317 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > ports before_response 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.938670 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > subnet before_response 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.939030 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > subnets before_response 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.939396 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > network after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.939752 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > network after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.940124 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > network after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.940476 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > port after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.940826 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > port after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.941173 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > port after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.941527 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > subnet after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.941875 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > subnet after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.942221 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.942809 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.plugin [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Modular L2 Plugin initialization complete Nov 18 18:13:21.943147 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading services supported by the core plugin {{(pid=102545) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 18 18:13:21.943484 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.plugins.ml2.managers [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Got port-security extension from driver 'port_security' Nov 18 18:13:21.943979 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.extensions.vlantransparent [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Disabled vlantransparent extension. Nov 18 18:13:21.944485 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102545) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 18 18:13:21.944807 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading Plugin: router Nov 18 18:13:21.981866 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router_interface before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.982262 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router after_create 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.982646 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router before_create 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.983023 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.983406 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.983771 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router after_delete 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.984172 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > floatingip after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.984659 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > floatingip after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.985033 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router after_create 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.985391 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router after_update 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.985750 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router after_update 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.986108 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.986478 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router after_update 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.986898 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router precommit_update 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.987275 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: port after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.987624 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: port after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.987995 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: subnet after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.988346 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.988703 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > port precommit_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.989059 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router precommit_create 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.989412 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: port before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.989763 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router precommit_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.990133 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router after_update 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.990485 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router precommit_delete 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.990844 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router precommit_create 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.991217 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.991575 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router precommit_update 55549900 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.992052 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > agent after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.992424 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > agent after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.992784 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > network after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:21.994170 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Tracking information for resource: router configured {{(pid=102545) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 18:13:21.994518 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Tracking information for resource: floatingip configured {{(pid=102545) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 18:13:21.999488 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.db.l3_agentschedulers_db [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 18 18:13:22.000103 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: port after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.000475 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: port after_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.000836 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: port after_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.001198 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: port after_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.002000 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router before_create 55550100 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.002378 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router precommit_delete 55550100 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.002751 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router precommit_create 55550100 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.003120 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > router precommit_update 55550100 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.008137 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.services.provider_configuration [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service providers = [] {{(pid=102545) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 18 18:13:22.008692 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.db.servicetype_db [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102545) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 18 18:13:22.012211 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.services.service_base [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102545) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 18 18:13:22.012526 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.services.service_base [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102545) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 18 18:13:22.012877 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.services.service_base [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102545) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 18 18:13:22.013779 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.services.service_base [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102545) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 18 18:13:22.014165 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.services.service_base [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 18 18:13:22.014547 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102545) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 18:13:22.014873 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 18 18:13:22.025914 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102545) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 18:13:22.026258 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading Plugin: auto_allocate Nov 18 18:13:22.032259 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: network precommit_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.032638 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: network precommit_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.033177 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102545) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 18:13:22.033505 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading Plugin: tag Nov 18 18:13:22.041861 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102545) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 18:13:22.042200 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading Plugin: timestamp Nov 18 18:13:22.046131 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102545) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 18:13:22.046468 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading Plugin: network_ip_availability Nov 18 18:13:22.052048 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.052431 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.052808 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.053552 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102545) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 18:13:22.053879 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading Plugin: flavors Nov 18 18:13:22.059566 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102545) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 18:13:22.059900 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading Plugin: revisions Nov 18 18:13:22.064299 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102545) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 18:13:22.064707 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_concurrency.lockutils [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.747s {{(pid=102545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 18 18:13:22.065461 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102545) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 18 18:13:22.065807 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Initializing extension manager. Nov 18 18:13:22.066332 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: __init__.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.066681 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: __pycache__ {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.067023 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.067363 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: address_group.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.068169 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.068751 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: address-group Nov 18 18:13:22.069087 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: address_scope.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.069815 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.070417 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: address-scope Nov 18 18:13:22.070750 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: admin_state_down_before_update.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.072354 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.072880 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: router-admin-state-down-before-update Nov 18 18:13:22.073216 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: agent.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.073936 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.074459 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: agent Nov 18 18:13:22.074793 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: agent_resources_synced.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.075723 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.076280 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: agent-resources-synced Nov 18 18:13:22.076615 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: allowedaddresspairs.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.078705 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.080321 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: allowed-address-pairs Nov 18 18:13:22.080451 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: auto_allocated_topology.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.081679 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.082209 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: auto-allocated-topology Nov 18 18:13:22.082547 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: availability_zone.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.083268 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.083785 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: availability_zone Nov 18 18:13:22.084150 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: availability_zone_filter.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.085085 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.085609 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: availability_zone_filter Nov 18 18:13:22.086052 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: data_plane_status.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.086992 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.087546 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension data-plane-status not supported by any of loaded plugins Nov 18 18:13:22.087883 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: default_subnetpools.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.088842 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.089362 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: default-subnetpools Nov 18 18:13:22.089694 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: dhcpagentscheduler.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.090587 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.091106 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: dhcp_agent_scheduler Nov 18 18:13:22.091437 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: dns.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.092401 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.092922 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension dns-integration not supported by any of loaded plugins Nov 18 18:13:22.093254 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: dns_domain_ports.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.094192 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.094708 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 18 18:13:22.095037 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.095991 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.096511 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 18 18:13:22.096844 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: dvr.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.097525 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.098041 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: dvr Nov 18 18:13:22.098369 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: ecmp_routes.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.099345 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.099864 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 18 18:13:22.100221 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: empty_string_filtering.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.101142 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.101655 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: empty-string-filtering Nov 18 18:13:22.101982 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.102906 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.103415 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 18 18:13:22.103743 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.104693 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.105202 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 18 18:13:22.105529 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: external_net.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.106461 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.106976 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: external-net Nov 18 18:13:22.107301 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: extra_dhcp_opt.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.108255 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.108773 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: extra_dhcp_opt Nov 18 18:13:22.109104 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: extraroute.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.110022 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.110539 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: extraroute Nov 18 18:13:22.110867 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: extraroute_atomic.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.111956 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.112556 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: extraroute-atomic Nov 18 18:13:22.112898 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: filter_validation.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.113577 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.114088 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: filter-validation Nov 18 18:13:22.114415 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: fip_pf_description.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.115548 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.116178 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 18 18:13:22.116511 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: fip_port_details.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.117698 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.118090 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: fip-port-details Nov 18 18:13:22.118925 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: flavors.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.120317 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.120759 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: flavors Nov 18 18:13:22.121092 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.122796 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.123327 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 18 18:13:22.123662 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: floatingip_pools.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.124401 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.124919 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: floatingip-pools Nov 18 18:13:22.125250 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: ip_allocation.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.126188 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.126701 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension ip_allocation not supported by any of loaded plugins Nov 18 18:13:22.127031 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.128049 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.128506 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: ip-substring-filtering Nov 18 18:13:22.128834 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: l2_adjacency.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.129772 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.130291 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 18 18:13:22.130618 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: l3.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.131627 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.132178 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: router Nov 18 18:13:22.132528 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: l3_conntrack_helper.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.135576 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.136132 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 18 18:13:22.136463 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.137420 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.137938 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: ext-gw-mode Nov 18 18:13:22.138272 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.139192 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.139712 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: l3-ha Nov 18 18:13:22.140075 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: l3_flavors.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.141002 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.141520 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: l3-flavors Nov 18 18:13:22.141850 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.142771 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.143294 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 18 18:13:22.143622 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: l3agentscheduler.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.144721 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.145229 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: l3_agent_scheduler Nov 18 18:13:22.145565 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: local_ip.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.147413 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.147898 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension local_ip not supported by any of loaded plugins Nov 18 18:13:22.148329 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: logging.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.150331 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.150871 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension logging not supported by any of loaded plugins Nov 18 18:13:22.151205 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: metering.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.152194 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.152807 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: metering Nov 18 18:13:22.153149 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.154270 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.154834 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: metering_source_and_destination_fields Nov 18 18:13:22.155133 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: multiprovidernet.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.156103 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.156631 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: multi-provider Nov 18 18:13:22.156962 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: netmtu.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.157895 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.158413 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: net-mtu Nov 18 18:13:22.158750 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: netmtu_writable.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.159691 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.160238 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: net-mtu-writable Nov 18 18:13:22.160574 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: network_availability_zone.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.161257 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.161770 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: network_availability_zone Nov 18 18:13:22.162099 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: network_ip_availability.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.163226 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.163751 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: network-ip-availability Nov 18 18:13:22.164115 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: network_segment_range.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.164947 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.166090 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension network-segment-range not supported by any of loaded plugins Nov 18 18:13:22.166425 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: pagination.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.167427 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.167763 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: pagination Nov 18 18:13:22.168116 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: port_device_profile.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.169055 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.169577 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: port-device-profile Nov 18 18:13:22.169907 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.170893 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.171359 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: port-mac-address-regenerate Nov 18 18:13:22.171688 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.172627 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.173152 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: port-numa-affinity-policy Nov 18 18:13:22.173480 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: port_resource_request.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.174409 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.174919 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension port-resource-request not supported by any of loaded plugins Nov 18 18:13:22.175251 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: port_resource_request_groups.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.176259 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.176771 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 18 18:13:22.177102 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: portbindings.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.178037 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.178560 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: binding Nov 18 18:13:22.178894 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: portbindings_extended.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.180318 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.180850 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: binding-extended Nov 18 18:13:22.181186 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: portsecurity.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.182114 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.182631 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: port-security Nov 18 18:13:22.182957 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: project_id.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.183970 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.184307 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: project-id Nov 18 18:13:22.184637 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: providernet.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.185568 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.186090 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: provider Nov 18 18:13:22.186424 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: qos.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.190215 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.190744 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension qos not supported by any of loaded plugins Nov 18 18:13:22.191116 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.192387 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.192909 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 18 18:13:22.193253 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.194173 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.194694 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 18 18:13:22.195029 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: qos_default.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.195987 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.197018 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension qos-default not supported by any of loaded plugins Nov 18 18:13:22.197349 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: qos_fip.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.198013 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.198523 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension qos-fip not supported by any of loaded plugins Nov 18 18:13:22.198852 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: qos_gateway_ip.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.199784 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.200328 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 18 18:13:22.200660 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: qos_port_network_policy.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.201614 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.202132 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 18 18:13:22.202464 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.203776 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.204529 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 18 18:13:22.204864 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: qos_pps_rule.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.206055 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.206578 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension qos-pps not supported by any of loaded plugins Nov 18 18:13:22.206903 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: qos_rule_type_details.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.207831 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.208379 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 18 18:13:22.208709 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: qos_rules_alias.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.209766 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.210288 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 18 18:13:22.210630 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: quota_check_limit.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.211615 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.212774 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: quota-check-limit Nov 18 18:13:22.213114 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: quotasv2.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.214113 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.214443 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: quotas Nov 18 18:13:22.214772 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: quotasv2_detail.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.218145 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.218489 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: quota_details Nov 18 18:13:22.218826 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: rbac.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.219909 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.220472 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: rbac-policies Nov 18 18:13:22.220803 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: rbac_address_group.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.221763 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.222296 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: rbac-address-group Nov 18 18:13:22.222629 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: rbac_address_scope.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.223583 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.224137 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: rbac-address-scope Nov 18 18:13:22.224467 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: rbac_security_groups.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.225394 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.225916 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: rbac-security-groups Nov 18 18:13:22.226258 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: rbac_subnetpool.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.227247 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.227796 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: rbac-subnetpool Nov 18 18:13:22.228146 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: revisionifmatch.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.229082 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.229597 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: revision-if-match Nov 18 18:13:22.229924 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: revisions.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.231063 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.231586 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: standard-attr-revisions Nov 18 18:13:22.231919 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: router_availability_zone.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.232636 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.233164 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: router_availability_zone Nov 18 18:13:22.233491 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: routerservicetype.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.234424 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.234941 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension router-service-type not supported by any of loaded plugins Nov 18 18:13:22.235269 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.236320 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.236842 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: security-groups-normalized-cidr Nov 18 18:13:22.237170 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: security_groups_port_filtering.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.238179 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.238700 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: port-security-groups-filtering Nov 18 18:13:22.239026 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.240042 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.240567 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: security-groups-remote-address-group Nov 18 18:13:22.240894 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.241887 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.242402 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: security-groups-shared-filtering Nov 18 18:13:22.242730 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.243425 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 18 18:13:22.244012 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: securitygroup.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.253768 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.254323 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: security-group Nov 18 18:13:22.254666 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: segment.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.255480 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.256028 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension segment not supported by any of loaded plugins Nov 18 18:13:22.256362 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.257361 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.257881 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 18 18:13:22.258215 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: servicetype.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.260130 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.260659 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: service-type Nov 18 18:13:22.260995 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: sorting.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.262011 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.262397 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: sorting Nov 18 18:13:22.262683 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: standard_attr_segment.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.263618 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.264163 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 18 18:13:22.264500 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: standardattrdescription.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.265165 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.265682 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: standard-attr-description Nov 18 18:13:22.266015 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: stateful_security_group.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.266967 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.267490 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: stateful-security-group Nov 18 18:13:22.267822 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: stdattrs_common.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.268437 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 18 18:13:22.268766 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.269704 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.270226 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 18 18:13:22.270583 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: subnet_onboard.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.271659 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.272214 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: subnet_onboard Nov 18 18:13:22.272547 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.273492 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.274013 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 18 18:13:22.274343 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: subnet_service_types.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.275903 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.276440 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: subnet-service-types Nov 18 18:13:22.276771 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: subnetallocation.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.277878 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.278399 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: subnet_allocation Nov 18 18:13:22.278750 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.279433 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.279992 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: subnetpool-prefix-ops Nov 18 18:13:22.280307 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.281262 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.281778 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 18 18:13:22.282123 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: tagging.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.283231 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.283759 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: standard-attr-tag Nov 18 18:13:22.284129 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: timestamp.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.285354 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.285882 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loaded extension: standard-attr-timestamp Nov 18 18:13:22.286217 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: trunk.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.287273 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.287800 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension trunk not supported by any of loaded plugins Nov 18 18:13:22.288164 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: trunk_details.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.289131 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.289697 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension trunk-details not supported by any of loaded plugins Nov 18 18:13:22.290028 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: uplink_status_propagation.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.291486 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.292035 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 18 18:13:22.292369 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Loading extension file: vlantransparent.py {{(pid=102545) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 18:13:22.293055 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102545) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 18:13:22.293585 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 18 18:13:22.296209 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:network Nov 18 18:13:22.296747 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:subnet Nov 18 18:13:22.297147 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:subnetpool Nov 18 18:13:22.297539 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:port Nov 18 18:13:22.298810 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.299270 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service FLAVORS assigned prefix: {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.299884 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.300351 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.300688 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:router Nov 18 18:13:22.301129 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:floatingip Nov 18 18:13:22.301628 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service METERING assigned prefix: /metering {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.303091 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.303467 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.303825 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102545) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:13:22.304869 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of CountableResource for resource:rbac_policy Nov 18 18:13:22.305321 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:security_group Nov 18 18:13:22.305870 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 18 18:13:22.306904 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service CORE assigned prefix: {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.307237 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:subnetpool Nov 18 18:13:22.307587 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] subnetpool is already registered Nov 18 18:13:22.308054 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service CORE assigned prefix: {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.308454 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:subnetpool Nov 18 18:13:22.308796 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] subnetpool is already registered Nov 18 18:13:22.311046 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.311483 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service FLAVORS assigned prefix: {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.312097 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.312525 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.312863 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:router Nov 18 18:13:22.313213 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] router is already registered Nov 18 18:13:22.313626 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:floatingip Nov 18 18:13:22.313970 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] floatingip is already registered Nov 18 18:13:22.314422 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service METERING assigned prefix: /metering {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.315083 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of CountableResource for resource:rbac_policy Nov 18 18:13:22.315416 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] rbac_policy is already registered Nov 18 18:13:22.315835 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:security_group Nov 18 18:13:22.316198 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] security_group is already registered Nov 18 18:13:22.316732 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 18 18:13:22.317070 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] security_group_rule is already registered Nov 18 18:13:22.317701 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service CORE assigned prefix: {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.318054 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:subnetpool Nov 18 18:13:22.318380 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] subnetpool is already registered Nov 18 18:13:22.318800 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.v2.resource_helper [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Service CORE assigned prefix: {{(pid=102545) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 18:13:22.319128 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Creating instance of TrackedResource for resource:subnetpool Nov 18 18:13:22.319525 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING neutron.quota.resource_registry [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] subnetpool is already registered Nov 18 18:13:22.319951 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: extensions {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.321469 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: address-groups {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.322963 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: address-scopes {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.324364 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: agents {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.325541 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: auto-allocated-topology {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.326808 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: availability_zones {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.328044 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: dhcp-networks {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.331016 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: dhcp-agents {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.332572 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: routers {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.334793 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: flavors {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.336101 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: service_profiles {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.337393 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: next_providers {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.338962 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: service_profiles {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.340567 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: floatingip-pools {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.341808 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: routers {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.343948 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: floatingips {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.345221 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: l3-routers {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.346616 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: l3-agents {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.348049 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: metering-labels {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.349415 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: metering-label-rules {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.350737 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: network-ip-availabilities {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.352026 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: bindings {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.354213 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: quotas {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.355779 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: quotas {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.357352 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: rbac-policies {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.358646 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: security-groups {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.359886 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: security-group-rules {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.361139 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: service-providers {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.362367 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: subnetpools {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.363806 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: subnetpools {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.365295 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: tags {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.367032 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: tags {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.369519 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: tags {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.371303 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: tags {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.373127 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: tags {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.374971 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: tags {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.376687 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: tags {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.378591 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: tags {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.380412 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: tags {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.382227 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron.api.extensions [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Extended resource: tags {{(pid=102545) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 18:13:22.389115 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING keystonemiddleware.auth_token [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 18 18:13:22.395417 dv-cinder-787764-6-iscsi neutron-server[102545]: WARNING keystonemiddleware.auth_token [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 18 18:13:22.405144 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_concurrency.lockutils [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Acquired lock "singleton_lock" {{(pid=102545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 18 18:13:22.405619 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_concurrency.lockutils [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Releasing lock "singleton_lock" {{(pid=102545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 18 18:13:22.406276 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO oslo_service.service [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Starting 2 workers Nov 18 18:13:22.411089 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Started child 102688 {{(pid=102545) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 18 18:13:22.416135 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Started child 102689 {{(pid=102545) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 18 18:13:22.417235 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:22.417914 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO neutron.service [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 18 18:13:22.418343 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Publish callbacks [] for process, before_spawn {{(pid=102545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:22.418799 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [-] (102688) wsgi starting up on http://0.0.0.0:9696 Nov 18 18:13:22.420817 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO oslo_service.service [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Starting 1 workers Nov 18 18:13:22.421709 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:22.423224 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [-] (102689) wsgi starting up on http://0.0.0.0:9696 Nov 18 18:13:22.426183 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Started child 102690 {{(pid=102545) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 18 18:13:22.426726 dv-cinder-787764-6-iscsi neutron-server[102545]: INFO oslo_service.service [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Starting 1 workers Nov 18 18:13:22.429823 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.service [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] calling RpcWorker wait() {{(pid=102690) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 18 18:13:22.430349 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.service [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] returning from RpcWorker wait() {{(pid=102690) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 18 18:13:22.431846 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Started child 102691 {{(pid=102545) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 18 18:13:22.432142 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:22.432584 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:13:22.432676 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG neutron_lib.callbacks.manager [None req-723118b2-1cb6-4ab6-a937-a5779d26ca15 None None] Publish callbacks [] for process, after_spawn {{(pid=102545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:22.434612 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102545) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 18 18:13:22.434823 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 18 18:13:22.435008 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 18 18:13:22.435229 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 18 18:13:22.435558 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 18 18:13:22.435743 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 18 18:13:22.436270 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.436549 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.436806 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.437080 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.437371 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.437954 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.438042 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:22.438535 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.438535 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.438702 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.438928 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.439096 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.439264 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.439487 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:13:22.439587 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.439724 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.440113 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.440374 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.440612 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.440869 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.441043 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.441292 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.441566 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.441796 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.442066 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] debug = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.442319 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.442790 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.443033 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.443276 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.443499 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.443771 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.444044 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.444410 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.444549 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.444784 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.445043 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.445379 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.445702 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.445951 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.446275 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.446468 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.446737 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.446959 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.447434 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] host = dv-cinder-787764-6-iscsi {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.447670 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.447887 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.448160 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.448428 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.448684 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.448924 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.449173 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.449434 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.449682 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.449927 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.450183 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.450426 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.450662 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.450915 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_file = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.451082 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_options = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.451301 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.451569 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.451839 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.452056 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.452227 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.452409 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.452676 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.452839 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.453094 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.453576 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.453789 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.454033 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.454269 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.454539 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.454775 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.455020 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.455235 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.455445 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.455690 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.455978 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.456196 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.456422 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.456670 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.456891 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.457109 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.457353 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.457576 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.457810 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.458026 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.458263 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.458508 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.458757 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.458995 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.459229 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.459491 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.459738 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.459995 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.460237 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.460489 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.460713 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.460969 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.461213 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.461426 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.461666 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.461901 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.462160 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.462393 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] use_json = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.462606 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.464476 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.464774 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.464964 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.465049 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.465461 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.465572 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.465782 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.466284 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.466558 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.466925 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.467185 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.467449 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.468439 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.468439 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.468439 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.471802 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.471802 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.471802 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.471802 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.471802 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.471802 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.471802 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.471802 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.472429 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.472429 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.472429 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.472429 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.472429 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.472429 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.472429 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.472429 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.472987 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.472987 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.472987 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.473276 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.473575 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.473860 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.82/identity {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.474129 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.474352 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.474604 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.475277 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.475277 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.475277 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.475489 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.475715 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.475955 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.476185 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.476426 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.476668 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.476891 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.477122 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.477385 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.478158 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.478406 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.479205 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.479461 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.479729 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.479994 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.480224 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.480456 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.480842 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.481280 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.481407 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.481591 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.482737 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.482737 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.482737 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.482737 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.482737 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.483093 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.483165 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.483531 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.483638 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.483825 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.485149 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.485149 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.485149 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.485149 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.485149 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.485149 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.485601 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.485601 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.485735 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.485983 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.486170 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.486386 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.486620 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.486847 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.487084 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.487338 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.487521 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.487727 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.488557 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.488557 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.488557 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.488801 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.488876 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.489822 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.489822 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.489822 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.490115 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.490115 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.490308 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.490534 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.490747 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.491126 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.491508 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.491910 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.492167 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.492579 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.492951 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.493397 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.494179 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.494505 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.494612 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.494833 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.495088 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.495315 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.495602 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.495862 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.496144 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.496378 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.496610 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.496889 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.497110 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.497409 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.497652 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.497915 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.498227 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.498503 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.498939 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.499039 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.499248 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.499521 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.499908 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.500112 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.500266 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.500617 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.500847 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.501000 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.501668 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.501668 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.501668 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.502100 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.502253 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.502457 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.502678 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.503046 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.503474 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.503882 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.504162 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.504455 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.504707 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.505326 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.507892 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.508187 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.82/identity {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.508458 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.508730 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.509032 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.509273 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.509539 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.509789 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.510006 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.510239 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.510468 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.510718 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.510966 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.511192 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.511417 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.511646 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.511868 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.512502 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.512671 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.513066 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.513332 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.513577 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.514020 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.514255 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.514478 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.514745 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.514997 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.515275 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.515540 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.515816 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.516080 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.516314 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.516577 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.516799 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.517051 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.517318 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.517546 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.517829 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.518065 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.518403 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.518686 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.518927 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.519168 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.519412 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.519669 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.520077 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.520351 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.520609 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.520870 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.521116 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.521361 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.521604 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.521848 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.522061 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.522285 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.522508 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.522778 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.523040 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.523307 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.523529 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.523746 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.524020 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.524243 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.524502 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.524818 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.525086 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.525324 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.525606 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.525831 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.526067 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.526341 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.526560 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.526780 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.527009 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.527248 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.527454 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.527709 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.527966 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.528165 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.528410 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.528617 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.528832 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.529095 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.529319 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.529542 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.529791 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.530010 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.530224 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.530475 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.530695 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.530912 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.531139 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.531356 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.531725 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.532154 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.532375 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.532592 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.532819 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.533045 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.533257 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.533553 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.533808 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.534052 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.534339 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.534575 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.534826 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.535086 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.535399 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.535629 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.535910 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.536170 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.536400 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.536647 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.536916 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.537272 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.537553 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.537805 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.538043 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.538343 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.538633 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1300:1349'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.538895 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.539132 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.539447 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.539782 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.540083 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.540854 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.541085 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.541350 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.541600 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.541822 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.542411 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.542669 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.542912 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.543186 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.543411 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.543664 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.543918 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.544225 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.544447 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.544684 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.544898 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.545166 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.546117 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.546510 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 18 18:13:22.547062 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102545) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 18 18:13:22.547236 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 18 18:13:22.547495 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 18 18:13:22.547742 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 18 18:13:22.547980 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 18 18:13:22.548124 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 18 18:13:22.548345 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.548514 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.548682 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.548848 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.549016 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.549205 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.549372 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.549593 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.549766 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.549929 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.550092 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.550256 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.550419 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.550589 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.550751 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.550916 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.551078 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.551245 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.551413 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.551572 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.551903 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.552093 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.552256 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] debug = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.552422 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.552634 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.552805 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.552968 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.553131 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.553292 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.553458 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.553617 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.553931 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.554091 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.554401 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.555038 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.555038 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.555038 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.555298 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.555377 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.555454 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.555623 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.555838 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] host = dv-cinder-787764-6-iscsi {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.556509 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.556681 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.556837 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.557001 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.557163 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.557325 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.557486 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.557647 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.557808 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.557972 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.558134 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.558295 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.558456 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.558617 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_file = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.558781 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_options = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.558947 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.559112 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.559272 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.559465 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.559631 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.559804 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.559996 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.560161 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.560324 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.560486 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.560648 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.560809 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.560972 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.561134 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.561295 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.561455 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.561618 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.561787 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.561948 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.562111 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.562270 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.562598 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.562758 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.563071 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.563237 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.563398 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.563555 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.563717 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.563877 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.564067 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.564228 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.564389 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.564550 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.564712 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.564879 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:13:22.565002 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.565093 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.565176 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.565339 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.565506 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.565669 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.565831 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.565991 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.566152 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.566313 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.566477 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.566638 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.566803 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] use_json = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.566965 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.567125 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.567287 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.567447 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.567607 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.567768 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.567955 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.568115 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 18:13:22.568299 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.568464 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.568682 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.568962 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.569159 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.569328 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.569493 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.569659 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.569824 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.569990 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.570162 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.570328 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.570504 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.570671 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.570837 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.571003 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.571168 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.571332 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.571523 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.571690 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.571855 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.572062 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.572238 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.572405 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.572571 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.572737 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.572903 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.573082 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.573247 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.573415 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.82/identity {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.573601 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.573744 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.573910 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.574075 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.574241 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.574406 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.574573 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.574737 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.574903 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.575068 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.575232 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.575397 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.575563 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.575728 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.575895 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.576133 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.576310 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.576462 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.576628 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.576793 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.577017 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.577160 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.577294 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.577427 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.577677 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.577901 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.578067 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.578485 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.578653 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.578806 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.578952 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.579121 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.579285 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.579449 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.579613 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.579777 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.579980 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.580147 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.580314 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.580480 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.580646 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.580812 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.580976 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.581140 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.581303 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.581470 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.581635 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.581800 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.581964 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.582189 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.582341 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.582473 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.582593 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.582762 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.583156 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.583327 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.583493 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.583659 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.583830 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.584037 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.584218 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.584384 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.584549 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.584714 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.584879 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.585044 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.585208 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.585372 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.585536 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.585701 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.585865 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.586029 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.586196 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.586365 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.586529 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.586692 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.586900 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.587601 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.587752 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.588089 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.588319 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.588418 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.588567 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.588731 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.588894 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.589058 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.589235 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.589402 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.589571 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.589737 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.589910 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.590086 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.590253 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.590418 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.590617 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.590782 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.590946 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.591110 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.591275 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.591440 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.591605 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.591769 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.592833 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.592833 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.592833 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.592833 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.592833 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.592833 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.593278 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.593278 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.593278 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.593479 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.593555 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.593695 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.593848 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.594021 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.594158 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.594312 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.594482 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.82/identity {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.594645 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.594811 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.594973 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.595596 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.595596 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.595596 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.595596 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.595877 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.595877 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.596060 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.596228 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.596393 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.596557 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.596722 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.596888 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.597103 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.597253 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.597385 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.597515 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.597666 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.597831 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.597995 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.598158 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.598321 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.598485 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.598650 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.598844 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.599009 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.599175 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.599341 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.599507 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.599672 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.599838 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.600029 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.600194 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.600360 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.600524 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.600690 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.600854 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.601020 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.601186 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.601371 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.601514 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.601672 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.601837 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.602002 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.602167 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.602333 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.602501 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.602736 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.603378 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.603534 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.603698 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.603863 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.604094 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.604245 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.604378 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.604521 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.604672 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.604836 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.605002 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.605169 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.605345 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.605512 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.605724 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.605858 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.605998 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.606130 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.606299 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.606463 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.606626 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.606790 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.606953 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.607117 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.607291 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.607456 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.607620 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.607787 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.607969 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.608142 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.608308 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.608472 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.608691 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.608827 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.608974 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.609101 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.609275 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.609438 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.609800 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.609800 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.610528 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.610706 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.610883 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.611049 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.611214 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.611422 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.611714 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.611841 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.612043 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.612211 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.612377 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.612553 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.612707 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.612874 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.613040 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.613216 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.613382 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.614327 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.614911 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.615085 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.615254 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.615534 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.615872 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.616081 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.616261 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.616428 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.616601 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.616773 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1300:1349'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.617436 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.617637 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.618538 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.618714 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.618915 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.619089 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.619253 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.619419 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.619583 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.619748 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.619912 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.620100 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.620265 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.620429 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.620593 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.620758 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.621316 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.621484 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.621650 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.622471 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.622655 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.622826 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.622993 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 18:13:22.623154 dv-cinder-787764-6-iscsi neutron-server[102545]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 18 18:13:22.764722 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 33680) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:13:22.773272 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [-] 10.222.0.82 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0064747 Nov 18 18:13:34.073566 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ce97768-fa47-4ea1-9a76-0d31fc086196 None None] get_active_networks_info from dv-cinder-787764-6-iscsi {{(pid=102690) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 18 18:13:34.143427 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ce97768-fa47-4ea1-9a76-0d31fc086196 None None] No non-hosted networks {{(pid=102690) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 18 18:13:34.164036 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.agentschedulers_db [None req-4ce97768-fa47-4ea1-9a76-0d31fc086196 None None] DHCP Agent not found on host dv-cinder-787764-6-iscsi {{(pid=102690) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 18 18:13:34.265648 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-33fa4d1b-5ecc-4262-9148-47ef71877dc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-432076'] for agent, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:36.406935 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e310a5c2-64b8-4679-bcec-35da9678c3c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-432076'] for agent, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:36.446060 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1a6bfeb6-2821-49e6-8ac1-4ef4a711575e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:37.766773 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-432076'] for agent, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:39.077149 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-432076'] for agent, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:39.299346 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.db.l3_hamode_db [None req-3f537c7f-616d-4ca9-ac55-ef8ab8dfe6e4 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 18 18:13:39.378094 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f537c7f-616d-4ca9-ac55-ef8ab8dfe6e4 None None] Routers set() bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:13:39.378573 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f537c7f-616d-4ca9-ac55-ef8ab8dfe6e4 None None] Router IDs set() for agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 18 18:13:40.149487 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-432076'] for agent, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:40.150510 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:40.150965 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:40.151426 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:40.151875 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:40.152362 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:40.152793 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:40.153700 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:40.154220 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:40.155812 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:40.156318 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:40.158184 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:40.158985 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:40.160277 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-787764-6-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:13:40.168737 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-787764-6-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:13:40.519553 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 33770) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:13:41.011744 dv-cinder-787764-6-iscsi neutron-server[102688]: WARNING oslo_policy.policy [None req-6b96fd94-4d49-47db-aa16-670cd85d9367 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 18:13:41.012402 dv-cinder-787764-6-iscsi neutron-server[102688]: WARNING oslo_policy.policy [None req-6b96fd94-4d49-47db-aa16-670cd85d9367 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 18:13:41.238185 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [None req-6b96fd94-4d49-47db-aa16-670cd85d9367 admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102688) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:13:41.251953 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-6b96fd94-4d49-47db-aa16-670cd85d9367 admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7188540 Nov 18 18:13:43.723665 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 33786) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:13:44.033399 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-a7b5ebb7-22f9-4f2a-85ff-ba8ba81803ea admin admin] Request body: {'subnetpool': {'default_prefixlen': 26, 'is_default': True, 'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16'], 'shared': True}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:13:44.129084 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.policy [None req-a7b5ebb7-22f9-4f2a-85ff-ba8ba81803ea admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102688) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 18 18:13:44.176423 dv-cinder-787764-6-iscsi neutron-server[102688]: WARNING oslo_policy.policy [None req-a7b5ebb7-22f9-4f2a-85ff-ba8ba81803ea admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 18:13:44.176813 dv-cinder-787764-6-iscsi neutron-server[102688]: WARNING oslo_policy.policy [None req-a7b5ebb7-22f9-4f2a-85ff-ba8ba81803ea admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 18:13:44.185803 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.quota [None req-a7b5ebb7-22f9-4f2a-85ff-ba8ba81803ea admin admin] Loaded quota_driver: . Nov 18 18:13:44.275875 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a7b5ebb7-22f9-4f2a-85ff-ba8ba81803ea admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8772717161496', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8772717163053', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8772717156666', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8772717208901', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8772717207390', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8772717195526', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-535463', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1367496', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-485821', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-406265'] for rbac-policy, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:44.341996 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a7b5ebb7-22f9-4f2a-85ff-ba8ba81803ea admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:44.343204 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a7b5ebb7-22f9-4f2a-85ff-ba8ba81803ea admin admin] 10.222.0.82 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6185288 Nov 18 18:13:47.026254 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 33798) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:13:47.321347 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Request body: {'network': {'project_id': '80dffda6828d411182f0fc847040137f', 'name': 'private', 'admin_state_up': True, 'tenant_id': '80dffda6828d411182f0fc847040137f'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:13:47.349472 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Made reservation on behalf of 80dffda6828d411182f0fc847040137f for: {'network': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:13:47.353401 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:47.370984 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:47.481454 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:47.485308 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:47.510279 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1346} {{(pid=102688) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:13:47.535544 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8772714931869', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:47.536135 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Unsubscribe: segment precommit_create {{(pid=102688) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 18 18:13:47.536639 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.segments_db [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Added segment 833a6a46-77e6-4b8c-8541-2f327e214320 of type vlan for network e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c Nov 18 18:13:47.542760 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8a6e4bd-a08c-476f-9dc7-700226759150,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:13:47.565244 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:47.565700 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:47.566114 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:47.566449 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:47.566779 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:47.567123 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:47.567452 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:47.567794 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:47.568161 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:47.568485 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:47.568802 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:47.569118 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Tracked resource versions report: Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: pushed versions: Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: { 'AddressGroup': {'1.2'}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'ConntrackHelper': {'1.0'}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Log': {'1.0'}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Network': {'1.1'}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Port': {'1.7'}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'PortForwarding': {'1.2'}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'QosPolicy': {'1.10'}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'SecurityGroup': {'1.5'}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'SecurityGroupRule': {'1.2'}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'SubPort': {'1.0'}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Subnet': {'1.1'}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Trunk': {'1.1'}} Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: consumer versions: Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: { DHCP agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: L3 agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: Metadata agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: Metering agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: Open vSwitch agent@dv-cinder-787764-6-iscsi: { 'AddressGroup': '1.2', Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'ConntrackHelper': '1.0', Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Log': '1.0', Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Network': '1.1', Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Port': '1.7', Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'PortForwarding': '1.2', Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'QosPolicy': '1.10', Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'SecurityGroup': '1.5', Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'SecurityGroupRule': '1.2', Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'SubPort': '1.0', Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Subnet': '1.1', Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Trunk': '1.1'}} Nov 18 18:13:47.570216 dv-cinder-787764-6-iscsi neutron-server[102688]: {{(pid=102688) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 18:13:47.658840 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:47.700286 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:47.701339 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:13:47.702066 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:47.752724 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 850 time: 0.7252839 Nov 18 18:13:47.809119 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31b51233-922f-4a0c-82f9-103a98f53ff2 admin admin] Pushing event updated for resources: {'Network': ['ID=e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:13:47.820934 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:13:50.501505 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 33812) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:13:50.890829 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5e21e99-d87d-482b-8d40-674fe4a48130 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:13:50.892207 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a5e21e99-d87d-482b-8d40-674fe4a48130 admin admin] 10.222.0.82 "GET /v2.0/networks/e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c HTTP/1.1" status: 200 len: 826 time: 0.3896551 Nov 18 18:13:50.917176 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-c6454955-cfbb-4877-baa3-f76b2a242c34 admin admin] 10.222.0.82 "GET /v2.0/subnetpools/0b3dd871-c780-43ca-af64-66d750554896 HTTP/1.1" status: 200 len: 734 time: 0.0188487 Nov 18 18:13:50.926191 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-0cba5955-c465-4910-926b-aea4c35c3ceb admin admin] Request body: {'subnet': {'ip_version': 4, 'name': 'private-subnet', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c', 'subnetpool_id': '0b3dd871-c780-43ca-af64-66d750554896', 'gateway_ip': '172.20.0.1'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:13:50.947972 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0cba5955-c465-4910-926b-aea4c35c3ceb admin admin] Made reservation on behalf of 80dffda6828d411182f0fc847040137f for: {'subnet': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:13:50.950337 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0cba5955-c465-4910-926b-aea4c35c3ceb admin admin] Publish callbacks [] for subnet, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:51.238294 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0cba5955-c465-4910-926b-aea4c35c3ceb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:51.302948 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cba5955-c465-4910-926b-aea4c35c3ceb admin admin] Pushing event updated for resources: {'Subnet': ['ID=c06ab8d6-2e14-4726-90d8-5a943a31695d,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:13:51.312847 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cba5955-c465-4910-926b-aea4c35c3ceb admin admin] Checking segment: {'id': '833a6a46-77e6-4b8c-8541-2f327e214320', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1346, 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:13:51.313241 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cba5955-c465-4910-926b-aea4c35c3ceb admin admin] Network hostable DHCP agents. Network: e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102688) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:13:51.333173 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cba5955-c465-4910-926b-aea4c35c3ceb admin admin] Network e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102688) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:13:51.343685 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-0cba5955-c465-4910-926b-aea4c35c3ceb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c) {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:13:51.348190 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0cba5955-c465-4910-926b-aea4c35c3ceb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:13:51.348775 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0cba5955-c465-4910-926b-aea4c35c3ceb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:51.355256 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8fe10567-5a3b-49f0-a1a1-accc78666af7 None None] Network e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:13:51.364877 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-0cba5955-c465-4910-926b-aea4c35c3ceb admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4418612 Nov 18 18:13:51.685500 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc1c763e3-2102-51f8-97fe-c751e57774c1-e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c', 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'fixed_ips': [{'subnet_id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d'}]}} from dv-cinder-787764-6-iscsi. {{(pid=102690) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 18:13:51.686825 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:51.981291 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.db_base_plugin_common [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Allocated IP 172.20.0.2 (e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c/c06ab8d6-2e14-4726-90d8-5a943a31695d/8365fd02-0db5-435e-893a-adf01e060323) {{(pid=102690) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:13:52.183506 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Publish callbacks [] for port, precommit_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:52.191730 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:52.266928 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Network e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c is already hosted by enough agents. {{(pid=102690) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:13:52.272069 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.base_scheduler [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Resources bound (agent type, host, resource id): {{(pid=102690) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:13:52.285760 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Received port after_create {{(pid=102690) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:13:52.288949 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Pushing event updated for resources: {'Port': ['ID=8365fd02-0db5-435e-893a-adf01e060323,revision_number=1']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:13:52.319001 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:52.319371 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:52.319717 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:52.320081 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:52.320418 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:52.320755 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:52.321081 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:52.321409 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:52.322288 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:52.322618 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:52.322944 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:52.323265 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Tracked resource versions report: Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: pushed versions: Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: { 'AddressGroup': {'1.2'}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'ConntrackHelper': {'1.0'}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Log': {'1.0'}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Network': {'1.1'}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Port': {'1.7'}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'PortForwarding': {'1.2'}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'QosPolicy': {'1.10'}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'SecurityGroup': {'1.5'}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'SecurityGroupRule': {'1.2'}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'SubPort': {'1.0'}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Subnet': {'1.1'}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Trunk': {'1.1'}} Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: consumer versions: Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: { DHCP agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: L3 agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: Metadata agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: Metering agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: Open vSwitch agent@dv-cinder-787764-6-iscsi: { 'AddressGroup': '1.2', Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'ConntrackHelper': '1.0', Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Log': '1.0', Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Network': '1.1', Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Port': '1.7', Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'PortForwarding': '1.2', Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'QosPolicy': '1.10', Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'SecurityGroup': '1.5', Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'SecurityGroupRule': '1.2', Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'SubPort': '1.0', Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Subnet': '1.1', Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Trunk': '1.1'}} Nov 18 18:13:52.324425 dv-cinder-787764-6-iscsi neutron-server[102690]: {{(pid=102690) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 18:13:52.375864 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Attempting to bind port 8365fd02-0db5-435e-893a-adf01e060323 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:13:52.376525 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Attempting to bind port 8365fd02-0db5-435e-893a-adf01e060323 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '833a6a46-77e6-4b8c-8541-2f327e214320', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1346, 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:13:52.376717 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Attempting to bind port 8365fd02-0db5-435e-893a-adf01e060323 on network e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:13:52.381632 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 13, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:13:52.382024 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Checking segment: {'id': '833a6a46-77e6-4b8c-8541-2f327e214320', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1346, 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:13:52.382502 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:52.382896 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Bound using segment: {'id': '833a6a46-77e6-4b8c-8541-2f327e214320', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1346, 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:13:52.383458 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Bound port: 8365fd02-0db5-435e-893a-adf01e060323, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '833a6a46-77e6-4b8c-8541-2f327e214320', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1346, 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:13:52.383869 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:52.450860 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] For port 8365fd02-0db5-435e-893a-adf01e060323, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:13:52.455432 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] For port 8365fd02-0db5-435e-893a-adf01e060323, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=8365fd02-0db5-435e-893a-adf01e060323,segment=NetworkSegment(833a6a46-77e6-4b8c-8541-2f327e214320),segment_id=833a6a46-77e6-4b8c-8541-2f327e214320)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:13:52.459826 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:13:52.526835 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcc41db8-2056-408b-9b52-f726552a70c6 None None] Pushing event updated for resources: {'Port': ['ID=8365fd02-0db5-435e-893a-adf01e060323,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:13:53.898147 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 33820) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:13:54.392929 dv-cinder-787764-6-iscsi neutron-server[102689]: WARNING oslo_policy.policy [None req-98e48009-5f3a-4b23-968e-004ce4442d2e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 18:13:54.393648 dv-cinder-787764-6-iscsi neutron-server[102689]: WARNING oslo_policy.policy [None req-98e48009-5f3a-4b23-968e-004ce4442d2e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 18:13:54.622128 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [None req-98e48009-5f3a-4b23-968e-004ce4442d2e admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:13:54.623445 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-98e48009-5f3a-4b23-968e-004ce4442d2e admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7225938 Nov 18 18:13:57.124975 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 33834) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:13:57.444081 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [None req-fc35fdba-b973-4aea-a475-582cc7d2a5c7 admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:13:57.445134 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-fc35fdba-b973-4aea-a475-582cc7d2a5c7 admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3191910 Nov 18 18:14:00.192843 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 33848) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:14:00.514499 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-76325088-4409-4665-b9a9-ff53e3b232f0 admin admin] Request body: {'router': {'admin_state_up': True, 'name': 'router1', 'tenant_id': '80dffda6828d411182f0fc847040137f'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:14:00.580581 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.policy [None req-76325088-4409-4665-b9a9-ff53e3b232f0 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102689) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 18 18:14:00.629411 dv-cinder-787764-6-iscsi neutron-server[102689]: WARNING oslo_policy.policy [None req-76325088-4409-4665-b9a9-ff53e3b232f0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 18:14:00.629994 dv-cinder-787764-6-iscsi neutron-server[102689]: WARNING oslo_policy.policy [None req-76325088-4409-4665-b9a9-ff53e3b232f0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 18:14:00.639126 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.quota [None req-76325088-4409-4665-b9a9-ff53e3b232f0 admin admin] Loaded quota_driver: . Nov 18 18:14:00.694304 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-76325088-4409-4665-b9a9-ff53e3b232f0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-430558', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-543'] for router, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:00.696213 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-76325088-4409-4665-b9a9-ff53e3b232f0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-430410', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-500004', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1631324', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-534'] for router, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:00.848789 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-76325088-4409-4665-b9a9-ff53e3b232f0 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:00.855558 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-76325088-4409-4665-b9a9-ff53e3b232f0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-430421', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-500439'] for router, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:00.875876 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-76325088-4409-4665-b9a9-ff53e3b232f0 admin admin] Publish callbacks [] for router, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:00.877117 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-76325088-4409-4665-b9a9-ff53e3b232f0 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6832578 Nov 18 18:14:01.580498 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a016e73-375d-44ce-83f2-302a46610631 None None] Network e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:14:01.706033 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-a7c01454-939f-4101-b488-5dc9ca268c09 None None] Provisioning complete for port 8365fd02-0db5-435e-893a-adf01e060323 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:14:01.706441 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a7c01454-939f-4101-b488-5dc9ca268c09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:01.873464 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 8365fd02-0db5-435e-893a-adf01e060323 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:14:01.896693 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a7c01454-939f-4101-b488-5dc9ca268c09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:01.967642 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-a7c01454-939f-4101-b488-5dc9ca268c09 None None] For port 8365fd02-0db5-435e-893a-adf01e060323, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=8365fd02-0db5-435e-893a-adf01e060323,segment=NetworkSegment(833a6a46-77e6-4b8c-8541-2f327e214320),segment_id=833a6a46-77e6-4b8c-8541-2f327e214320)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:14:01.977338 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a7c01454-939f-4101-b488-5dc9ca268c09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:02.002263 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 8365fd02-0db5-435e-893a-adf01e060323 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:14:02.002634 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:02.060709 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7c01454-939f-4101-b488-5dc9ca268c09 None None] Pushing event updated for resources: {'Port': ['ID=8365fd02-0db5-435e-893a-adf01e060323,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:02.198267 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-3248c23c-ba5d-41c1-b7c8-477db4a6646d None None] Provisioning complete for port 8365fd02-0db5-435e-893a-adf01e060323 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:14:02.198558 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3248c23c-ba5d-41c1-b7c8-477db4a6646d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:03.397882 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 33860) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:14:03.713082 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [None req-0e999595-1974-489c-82f8-c18bb9326aee admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:14:03.714070 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-0e999595-1974-489c-82f8-c18bb9326aee admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3152530 Nov 18 18:14:03.839212 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 8365fd02-0db5-435e-893a-adf01e060323 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:14:03.889272 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 8365fd02-0db5-435e-893a-adf01e060323 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:14:03.889646 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:03.986778 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-cc2f044b-e7c8-40b4-9589-7984d96a4b3c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:06.197862 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 33868) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:14:06.407133 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-23600b44-b293-428b-bccf-143438e135ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:06.535690 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Request body: {'network': {'provider:physical_network': 'physnet1', 'admin_state_up': True, 'is_default': True, 'router:external': True, 'provider:network_type': 'flat', 'name': 'public'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:14:06.560659 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Made reservation on behalf of d5fcab64311d4a38a70ce00e512474fc for: {'network': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:14:06.564049 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:06.582083 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:06.703636 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:06.708030 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:06.720672 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Reserving flat network on physical network physnet1 {{(pid=102689) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 18 18:14:06.756906 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8772714931869', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:06.757496 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Unsubscribe: segment precommit_create {{(pid=102689) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 18 18:14:06.758011 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.segments_db [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Added segment 94f1c6ed-c97a-45f3-94c4-d04f9231084d of type flat for network 2cab888d-52a8-434c-814e-4f25740decd0 Nov 18 18:14:06.775187 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=43a6c49b-0dc6-4cf2-8411-ee16c781746e,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:06.826480 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:06.826847 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:06.827199 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:06.827577 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:06.827909 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:06.828286 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:06.828634 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:06.828988 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:06.829343 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:06.829684 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:06.830269 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:06.830597 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Tracked resource versions report: Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: pushed versions: Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: { 'AddressGroup': {'1.2'}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'ConntrackHelper': {'1.0'}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Log': {'1.0'}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Network': {'1.1'}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Port': {'1.7'}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'PortForwarding': {'1.2'}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'QosPolicy': {'1.10'}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'SecurityGroup': {'1.5'}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'SecurityGroupRule': {'1.2'}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'SubPort': {'1.0'}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Subnet': {'1.1'}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Trunk': {'1.1'}} Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: consumer versions: Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: { DHCP agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: L3 agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: Metadata agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: Metering agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: Open vSwitch agent@dv-cinder-787764-6-iscsi: { 'AddressGroup': '1.2', Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'ConntrackHelper': '1.0', Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Log': '1.0', Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Network': '1.1', Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Port': '1.7', Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'PortForwarding': '1.2', Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'QosPolicy': '1.10', Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'SecurityGroup': '1.5', Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'SecurityGroupRule': '1.2', Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'SubPort': '1.0', Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Subnet': '1.1', Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Trunk': '1.1'}} Nov 18 18:14:06.831850 dv-cinder-787764-6-iscsi neutron-server[102689]: {{(pid=102689) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 18:14:06.887977 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:06.931798 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:06.933034 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:14:06.933746 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:06.982457 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.7834520 Nov 18 18:14:07.038083 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c5c8a88-1ec1-4a77-a8af-efc9c7bef562 admin admin] Pushing event updated for resources: {'Network': ['ID=2cab888d-52a8-434c-814e-4f25740decd0,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:07.051012 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network 2cab888d-52a8-434c-814e-4f25740decd0 details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:14:07.641013 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:08.972697 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:09.485694 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 33890) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:14:09.698799 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7d7c0a9-89c4-4ffd-a158-ea8203f2ed9a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:14:09.700200 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-a7d7c0a9-89c4-4ffd-a158-ea8203f2ed9a admin admin] 10.222.0.82 "GET /v2.0/subnets/c06ab8d6-2e14-4726-90d8-5a943a31695d HTTP/1.1" status: 200 len: 849 time: 0.2135355 Nov 18 18:14:09.832149 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-a15f4fa7-c2ca-44f5-bb70-3a8a59339948 admin admin] 10.222.0.82 "GET /v2.0/routers/f6fe8306-949d-43ac-b773-00c61fd4b6da HTTP/1.1" status: 200 len: 704 time: 0.1255889 Nov 18 18:14:10.089005 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:10.174020 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:10.385120 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Allocated IP 172.20.0.1 (e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c/c06ab8d6-2e14-4726-90d8-5a943a31695d/2aacfe0f-199c-4cf1-a64c-69fe5a819398) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:14:10.572246 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:10.638565 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:10.706597 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Network e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:14:10.711286 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:14:10.718505 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:14:10.719028 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-500260'] for router_interface, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:10.782880 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Pushing event updated for resources: {'Port': ['ID=2aacfe0f-199c-4cf1-a64c-69fe5a819398,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:10.920349 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:10.947468 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-1bdee980-9e01-4184-abbc-7b852ba66caf None None] Provisioning complete for port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:14:10.947837 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1bdee980-9e01-4184-abbc-7b852ba66caf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:10.982156 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-1bdee980-9e01-4184-abbc-7b852ba66caf None None] Port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:14:11.173777 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:11.178172 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:11.178912 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1772530', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-499092'] for router_interface, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:11.235365 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Pushing event updated for resources: {'Port': ['ID=2aacfe0f-199c-4cf1-a64c-69fe5a819398,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:11.300482 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Network e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:14:11.301782 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:14:11.459417 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Router f6fe8306-949d-43ac-b773-00c61fd4b6da is scheduled to L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 with binding_index 1 {{(pid=102689) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 18:14:11.503818 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-15cf3d86-8e24-4763-bd4f-b5cf56a6d3e5 None None] Provisioning complete for port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:14:11.504440 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-15cf3d86-8e24-4763-bd4f-b5cf56a6d3e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:11.539574 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-15cf3d86-8e24-4763-bd4f-b5cf56a6d3e5 None None] Port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:14:11.550028 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:14:11.555417 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-a5f87055-677b-4dd3-a5bd-6ee7131e8aac admin admin] 10.222.0.82 "PUT /v2.0/routers/f6fe8306-949d-43ac-b773-00c61fd4b6da/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.7169003 Nov 18 18:14:11.572167 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Sync routers for ids ['f6fe8306-949d-43ac-b773-00c61fd4b6da'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:14:11.584462 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Routers {'f6fe8306-949d-43ac-b773-00c61fd4b6da'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:14:11.585298 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:14:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['f6fe8306-949d-43ac-b773-00c61fd4b6da'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:14:11.774297 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Set router f6fe8306-949d-43ac-b773-00c61fd4b6da gateway port host: None {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:14:12.203454 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'name': 'router1', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:14:00Z', 'updated_at': '2021-11-18T18:14:10Z', 'revision_number': 2, 'project_id': '80dffda6828d411182f0fc847040137f', 'gw_port_host': None, '_interfaces': [{'id': '2aacfe0f-199c-4cf1-a64c-69fe5a819398', 'name': '', 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'mac_address': 'fa:16:3e:20:c2:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:14:10Z', 'updated_at': '2021-11-18T18:14:11Z', 'revision_number': 2, 'project_id': '80dffda6828d411182f0fc847040137f', 'subnets': [{'id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0b3dd871-c780-43ca-af64-66d750554896'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:14:12.254388 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Checking router: f6fe8306-949d-43ac-b773-00c61fd4b6da for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:14:12.254764 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Updating router f6fe8306-949d-43ac-b773-00c61fd4b6da port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 binding host dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:14:12.302491 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:12.819082 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Publish callbacks [] for port, precommit_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:12.826999 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:12.991060 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Attempting to bind port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:14:12.991468 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Attempting to bind port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '833a6a46-77e6-4b8c-8541-2f327e214320', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1346, 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c'}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:14:12.991898 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Attempting to bind port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 on network e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:14:12.997069 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Pushing event updated for resources: {'Port': ['ID=2aacfe0f-199c-4cf1-a64c-69fe5a819398,revision_number=3']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:12.999573 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 14, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:14:13.000010 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Checking segment: {'id': '833a6a46-77e6-4b8c-8541-2f327e214320', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1346, 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102691) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:14:13.000492 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:13.000890 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Bound using segment: {'id': '833a6a46-77e6-4b8c-8541-2f327e214320', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1346, 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c'} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:14:13.001391 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Bound port: 2aacfe0f-199c-4cf1-a64c-69fe5a819398, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '833a6a46-77e6-4b8c-8541-2f327e214320', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1346, 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c'}}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:14:13.001789 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:13.020647 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:13.021014 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:13.021359 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:13.021696 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:13.022031 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:13.022366 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:13.022696 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:13.023025 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:13.023357 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:13.023681 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:13.024029 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:13.024354 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Tracked resource versions report: Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: pushed versions: Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: { 'AddressGroup': {'1.2'}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'ConntrackHelper': {'1.0'}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Log': {'1.0'}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Network': {'1.1'}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Port': {'1.7'}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'PortForwarding': {'1.2'}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'QosPolicy': {'1.10'}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'SecurityGroup': {'1.5'}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'SecurityGroupRule': {'1.2'}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'SubPort': {'1.0'}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Subnet': {'1.1'}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Trunk': {'1.1'}} Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: consumer versions: Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: { DHCP agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: L3 agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: Metadata agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: Metering agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: Open vSwitch agent@dv-cinder-787764-6-iscsi: { 'AddressGroup': '1.2', Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'ConntrackHelper': '1.0', Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Log': '1.0', Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Network': '1.1', Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Port': '1.7', Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'PortForwarding': '1.2', Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'QosPolicy': '1.10', Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'SecurityGroup': '1.5', Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'SecurityGroupRule': '1.2', Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'SubPort': '1.0', Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Subnet': '1.1', Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Trunk': '1.1'}} Nov 18 18:14:13.026008 dv-cinder-787764-6-iscsi neutron-server[102691]: {{(pid=102691) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 18:14:13.067246 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-1aa21937-1a18-4880-95d3-61175d25d9e3 None None] Provisioning complete for port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:14:13.067977 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1aa21937-1a18-4880-95d3-61175d25d9e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:13.082036 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] For port 2aacfe0f-199c-4cf1-a64c-69fe5a819398, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102691) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:14:13.101767 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] For port 2aacfe0f-199c-4cf1-a64c-69fe5a819398, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=2aacfe0f-199c-4cf1-a64c-69fe5a819398,segment=NetworkSegment(833a6a46-77e6-4b8c-8541-2f327e214320),segment_id=833a6a46-77e6-4b8c-8541-2f327e214320)] {{(pid=102691) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:14:13.102183 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-1aa21937-1a18-4880-95d3-61175d25d9e3 None None] Port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:14:13.107503 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:13.161564 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9569d294-cef3-4506-9fdc-983f0f58bf68 None None] Pushing event updated for resources: {'Port': ['ID=2aacfe0f-199c-4cf1-a64c-69fe5a819398,revision_number=4']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:13.169099 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Routers {'f6fe8306-949d-43ac-b773-00c61fd4b6da'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:14:13.169713 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:14:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['f6fe8306-949d-43ac-b773-00c61fd4b6da'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:14:13.262863 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] Set router f6fe8306-949d-43ac-b773-00c61fd4b6da gateway port host: None {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:14:13.322935 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-f47a4d0e-9e85-4e3a-9928-bf9839d72e6a None None] Provisioning complete for port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:14:13.323387 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f47a4d0e-9e85-4e3a-9928-bf9839d72e6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:13.403632 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f47a4d0e-9e85-4e3a-9928-bf9839d72e6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:13.435327 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-f47a4d0e-9e85-4e3a-9928-bf9839d72e6a None None] For port 2aacfe0f-199c-4cf1-a64c-69fe5a819398, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=2aacfe0f-199c-4cf1-a64c-69fe5a819398,segment=NetworkSegment(833a6a46-77e6-4b8c-8541-2f327e214320),segment_id=833a6a46-77e6-4b8c-8541-2f327e214320)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:14:13.440929 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f47a4d0e-9e85-4e3a-9928-bf9839d72e6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:13.474802 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'name': 'router1', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:14:00Z', 'updated_at': '2021-11-18T18:14:10Z', 'revision_number': 2, 'project_id': '80dffda6828d411182f0fc847040137f', 'gw_port_host': None, '_interfaces': [{'id': '2aacfe0f-199c-4cf1-a64c-69fe5a819398', 'name': '', 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'mac_address': 'fa:16:3e:20:c2:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:14:10Z', 'updated_at': '2021-11-18T18:14:13Z', 'revision_number': 4, 'project_id': '80dffda6828d411182f0fc847040137f', 'subnets': [{'id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0b3dd871-c780-43ca-af64-66d750554896'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:14:13.489511 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f47a4d0e-9e85-4e3a-9928-bf9839d72e6a None None] Pushing event updated for resources: {'Port': ['ID=2aacfe0f-199c-4cf1-a64c-69fe5a819398,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:13.504259 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a516df5f-8e02-4dd7-86fb-af85046b8d4d None None] The sync data for ids ['f6fe8306-949d-43ac-b773-00c61fd4b6da'] in dv-cinder-787764-6-iscsi is: [{'id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'name': 'router1', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:14:00Z', 'updated_at': '2021-11-18T18:14:10Z', 'revision_number': 2, 'project_id': '80dffda6828d411182f0fc847040137f', 'gw_port_host': None, '_interfaces': [{'id': '2aacfe0f-199c-4cf1-a64c-69fe5a819398', 'name': '', 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'mac_address': 'fa:16:3e:20:c2:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:14:10Z', 'updated_at': '2021-11-18T18:14:13Z', 'revision_number': 4, 'project_id': '80dffda6828d411182f0fc847040137f', 'subnets': [{'id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0b3dd871-c780-43ca-af64-66d750554896'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:14:13.921733 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 33910) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:14:14.032659 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7f2cb73-8cd2-4c5c-9b5f-b094e01273fb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:14:14.033929 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-b7f2cb73-8cd2-4c5c-9b5f-b094e01273fb admin admin] 10.222.0.82 "GET /v2.0/networks/2cab888d-52a8-434c-814e-4f25740decd0 HTTP/1.1" status: 200 len: 842 time: 0.1111584 Nov 18 18:14:14.044225 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] Request body: {'subnet': {'enable_dhcp': False, 'cidr': '172.27.1.0/24', 'ip_version': 4, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'name': 'public-subnet', 'gateway_ip': '172.27.1.1'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:14:14.069564 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] Made reservation on behalf of d5fcab64311d4a38a70ce00e512474fc for: {'subnet': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:14:14.071872 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] Publish callbacks [] for subnet, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:14.365588 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.objects.ports [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102689) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 18 18:14:14.366002 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:14.425023 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] Pushing event updated for resources: {'Subnet': ['ID=27c45147-26a4-4b40-9fdf-2f6fc0a394bf,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:14.429394 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] Checking segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:14:14.429743 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] Network hostable DHCP agents. Network: 2cab888d-52a8-434c-814e-4f25740decd0, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102689) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:14:14.452173 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] Network 2cab888d-52a8-434c-814e-4f25740decd0 is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102689) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:14:14.463117 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, 2cab888d-52a8-434c-814e-4f25740decd0) {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:14:14.467186 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:14:14.467774 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:14.473891 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ec180a5-68a8-4028-9211-e65ec2be04a9 None None] Network 2cab888d-52a8-434c-814e-4f25740decd0 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:14:14.492613 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-d3320c07-9a8e-4ae2-9ba0-e43432b32c7b admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4521177 Nov 18 18:14:14.606843 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92e6cba0-3869-4704-9a82-7cb314212646 None None] Network 2cab888d-52a8-434c-814e-4f25740decd0 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:14:16.887970 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 33918) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:14:17.019419 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-42c0c1b5-72f6-413d-b4d5-553109dd12fb admin admin] 10.222.0.82 "GET /v2.0/routers/f6fe8306-949d-43ac-b773-00c61fd4b6da HTTP/1.1" status: 200 len: 710 time: 0.1302383 Nov 18 18:14:17.103462 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-884d7618-8e3f-4fc8-82cc-fe38c7fe4837 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:14:17.110366 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-884d7618-8e3f-4fc8-82cc-fe38c7fe4837 admin admin] 10.222.0.82 "GET /v2.0/networks/2cab888d-52a8-434c-814e-4f25740decd0 HTTP/1.1" status: 200 len: 886 time: 0.0791075 Nov 18 18:14:17.114549 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:14:17.435599 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:17.665066 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:17.739308 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:17.841144 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Allocated IP 172.27.1.218 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:14:17.939663 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:17.974278 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:18.013446 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:14:18.016206 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:14:18.024219 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:14:18.026926 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Pushing event updated for resources: {'Port': ['ID=15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:18.263172 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:18.454306 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-500022', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-430428', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-548'] for router, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:18.458041 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-500439', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-500421', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-500428', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-430439'] for router, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:18.565975 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Router f6fe8306-949d-43ac-b773-00c61fd4b6da has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:14:18.747859 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:14:18.752074 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] Publish callbacks [] for router, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:18.753239 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-920b19ba-24cc-4748-9e5c-f13677c58633 admin admin] 10.222.0.82 "PUT /v2.0/routers/f6fe8306-949d-43ac-b773-00c61fd4b6da HTTP/1.1" status: 200 len: 890 time: 1.6421649 Nov 18 18:14:19.873877 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 2aacfe0f-199c-4cf1-a64c-69fe5a819398 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:14:19.921756 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:14:19.922186 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:20.460896 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Sync routers for ids ['f6fe8306-949d-43ac-b773-00c61fd4b6da'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:14:20.472194 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Routers {'f6fe8306-949d-43ac-b773-00c61fd4b6da'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:14:20.472892 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:14:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['f6fe8306-949d-43ac-b773-00c61fd4b6da'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:14:20.678389 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Set router f6fe8306-949d-43ac-b773-00c61fd4b6da gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:14:21.139697 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'name': 'router1', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.218'}], 'enable_snat': True}, 'gw_port_id': '15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:14:00Z', 'updated_at': '2021-11-18T18:14:18Z', 'revision_number': 4, 'project_id': '80dffda6828d411182f0fc847040137f', 'gw_port': {'id': '15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:d9:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.218', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:14:17Z', 'updated_at': '2021-11-18T18:14:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '2aacfe0f-199c-4cf1-a64c-69fe5a819398', 'name': '', 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'mac_address': 'fa:16:3e:20:c2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:14:10Z', 'updated_at': '2021-11-18T18:14:13Z', 'revision_number': 5, 'project_id': '80dffda6828d411182f0fc847040137f', 'subnets': [{'id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0b3dd871-c780-43ca-af64-66d750554896'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:14:21.190555 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Checking router: f6fe8306-949d-43ac-b773-00c61fd4b6da for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:14:21.190904 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Updating router f6fe8306-949d-43ac-b773-00c61fd4b6da port 15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5 binding host dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:14:21.237577 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:21.271071 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 33930) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:14:21.417499 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-054ff2d0-1b15-44c4-8383-27693062f044 admin admin] 10.222.0.82 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1452258 Nov 18 18:14:21.558261 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Publish callbacks [] for port, precommit_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:21.567007 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:21.621114 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Attempting to bind port 15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:14:21.621486 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Attempting to bind port 15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:14:21.621855 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Attempting to bind port 15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5 on network 2cab888d-52a8-434c-814e-4f25740decd0 {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:14:21.623842 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d464f801-8e0e-46aa-8e1e-9f4deeb68103 None None] Pushing event updated for resources: {'Port': ['ID=15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:21.634008 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 14, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:14:21.634419 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Checking segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:14:21.634843 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:21.635219 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Bound using segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:14:21.635690 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Bound port: 15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:14:21.636224 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:21.685706 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] For port 15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:14:21.688793 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] For port 15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:14:21.692808 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:21.751649 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d464f801-8e0e-46aa-8e1e-9f4deeb68103 None None] Pushing event updated for resources: {'Port': ['ID=15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:21.754671 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Routers {'f6fe8306-949d-43ac-b773-00c61fd4b6da'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:14:21.755634 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:14:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['f6fe8306-949d-43ac-b773-00c61fd4b6da'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:14:21.863705 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] Set router f6fe8306-949d-43ac-b773-00c61fd4b6da gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:14:22.076723 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'name': 'router1', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.218'}], 'enable_snat': True}, 'gw_port_id': '15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:14:00Z', 'updated_at': '2021-11-18T18:14:18Z', 'revision_number': 4, 'project_id': '80dffda6828d411182f0fc847040137f', 'gw_port': {'id': '15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:d9:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.218', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:14:17Z', 'updated_at': '2021-11-18T18:14:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '2aacfe0f-199c-4cf1-a64c-69fe5a819398', 'name': '', 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'mac_address': 'fa:16:3e:20:c2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:14:10Z', 'updated_at': '2021-11-18T18:14:13Z', 'revision_number': 5, 'project_id': '80dffda6828d411182f0fc847040137f', 'subnets': [{'id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0b3dd871-c780-43ca-af64-66d750554896'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:14:22.104357 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e17c9b3b-284d-4c45-b70f-db508b988db0 None None] The sync data for ids ['f6fe8306-949d-43ac-b773-00c61fd4b6da'] in dv-cinder-787764-6-iscsi is: [{'id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'name': 'router1', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.218'}], 'enable_snat': True}, 'gw_port_id': '15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:14:00Z', 'updated_at': '2021-11-18T18:14:18Z', 'revision_number': 4, 'project_id': '80dffda6828d411182f0fc847040137f', 'gw_port': {'id': '15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:d9:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.218', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:14:17Z', 'updated_at': '2021-11-18T18:14:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '2aacfe0f-199c-4cf1-a64c-69fe5a819398', 'name': '', 'network_id': 'e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c', 'tenant_id': '80dffda6828d411182f0fc847040137f', 'mac_address': 'fa:16:3e:20:c2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f6fe8306-949d-43ac-b773-00c61fd4b6da', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:14:10Z', 'updated_at': '2021-11-18T18:14:13Z', 'revision_number': 5, 'project_id': '80dffda6828d411182f0fc847040137f', 'subnets': [{'id': 'c06ab8d6-2e14-4726-90d8-5a943a31695d', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0b3dd871-c780-43ca-af64-66d750554896'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:14:23.889146 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:14:23.944106 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:14:23.944482 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:24.023535 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:24.045585 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port 15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:14:24.056579 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:24.141676 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:14:25.889936 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:14:25.973648 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 15c23ad2-e4cd-42ed-bfb8-6bf099ed18a5 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:14:25.974812 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:33.970942 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-308a39ec-d6e1-40f1-8181-0449a86fa0cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:35.502305 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 5 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:14:36.404814 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-2f061202-e707-4e9f-aa0b-4a20c32991df None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:37.647942 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:38.976567 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:14:40.142651 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:03.976057 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-445d1959-c2e3-490f-a47f-de35ad679c85 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:06.402689 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-78a82ec9-521d-43dd-b860-4c2bbc1f8cfe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:07.646150 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:08.981326 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:10.136670 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:12.499483 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 5 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:15:33.970535 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d98e2b44-cd93-469c-bc86-409a05587c07 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:36.395731 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-98ed0d26-5ba7-4264-bb8d-a808e1c4cad3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:37.648957 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:38.982667 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:40.138521 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:40.651258 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34414) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:15:40.711072 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.pecan_wsgi.hooks.translation [None req-16dc402a-711f-43fc-bcb2-eee49eca3a38 admin admin] GET failed (client error): The resource could not be found. Nov 18 18:15:40.712365 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-16dc402a-711f-43fc-bcb2-eee49eca3a38 admin admin] 10.222.0.82 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0601425 Nov 18 18:15:40.875647 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ee92b40-97e4-4db4-9296-0d20ca6d9e97 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:40.877047 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-6ee92b40-97e4-4db4-9296-0d20ca6d9e97 admin admin] 10.222.0.82 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 873 time: 0.1601417 Nov 18 18:15:43.144574 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34424) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:15:43.235061 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea5f4268-6bc7-4ec7-b2a5-fcd7d5cc0ffd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:43.236418 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-ea5f4268-6bc7-4ec7-b2a5-fcd7d5cc0ffd admin admin] 10.222.0.82 "GET /v2.0/subnets/c06ab8d6-2e14-4726-90d8-5a943a31695d HTTP/1.1" status: 200 len: 849 time: 0.0908706 Nov 18 18:15:43.246744 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:15:43.327600 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Publish callbacks [] for subnet, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:43.469858 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8772714945814'] for subnet, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:43.506880 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:43.507487 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:43.507820 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-734a7cc5-a24a-4e62-88a1-31c81f0be899 None None] Network e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:15:43.508826 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] 10.222.0.82 "PUT /v2.0/subnets/c06ab8d6-2e14-4726-90d8-5a943a31695d HTTP/1.1" status: 200 len: 868 time: 0.2661917 Nov 18 18:15:43.524917 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c06ab8d6-2e14-4726-90d8-5a943a31695d,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:15:43.532667 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:15:43.533039 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:15:43.533386 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:15:43.533775 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:15:43.534169 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:15:43.534511 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:15:43.534844 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:15:43.535175 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:15:43.535504 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:15:43.535879 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:15:43.536235 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:15:43.536561 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ca92759-7390-456b-be63-692aa459eef5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:15:43.871124 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-e04d28e2-c4e3-4d47-bb97-42278e4272c2 None None] Provisioning complete for port 8365fd02-0db5-435e-893a-adf01e060323 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:15:43.871585 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e04d28e2-c4e3-4d47-bb97-42278e4272c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:43.954716 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-e04d28e2-c4e3-4d47-bb97-42278e4272c2 None None] Provisioning complete for port 2aacfe0f-199c-4cf1-a64c-69fe5a819398 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:15:43.954974 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e04d28e2-c4e3-4d47-bb97-42278e4272c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:15:45.762920 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34432) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:15:45.964590 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-965bd8f5-f487-483f-a52f-dfd5d6705cc0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:45.964953 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-965bd8f5-f487-483f-a52f-dfd5d6705cc0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:45.966540 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-965bd8f5-f487-483f-a52f-dfd5d6705cc0 admin admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1550 time: 0.2026620 Nov 18 18:15:48.217053 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34440) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:15:48.349445 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4df31d44-3176-4c3e-b69f-b3a20158b9d8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:48.349921 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4df31d44-3176-4c3e-b69f-b3a20158b9d8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:48.351454 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-4df31d44-3176-4c3e-b69f-b3a20158b9d8 admin admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1550 time: 0.1334567 Nov 18 18:15:49.497620 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 5 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:15:50.603630 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34448) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:15:50.751283 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51bcebff-1bc4-489f-a6ba-31a860ee1abd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:50.753485 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-51bcebff-1bc4-489f-a6ba-31a860ee1abd admin admin] 10.222.0.82 "GET /v2.0/networks/2cab888d-52a8-434c-814e-4f25740decd0 HTTP/1.1" status: 200 len: 886 time: 0.1488369 Nov 18 18:15:53.014306 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34456) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:15:53.157430 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5dad9024-8f20-4ef7-918c-3bc3d35ae6be admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:53.158807 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-5dad9024-8f20-4ef7-918c-3bc3d35ae6be admin admin] 10.222.0.82 "GET /v2.0/networks/e21c1ecb-ecd3-41bd-aba0-71d4ee6fcf2c HTTP/1.1" status: 200 len: 870 time: 0.1436203 Nov 18 18:15:55.395518 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34464) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:15:55.521276 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b8f479e-bae1-4942-90fc-2f8d07992996 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:55.521729 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b8f479e-bae1-4942-90fc-2f8d07992996 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:55.523242 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-0b8f479e-bae1-4942-90fc-2f8d07992996 admin admin] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1266079 Nov 18 18:15:57.806609 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34472) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:15:57.896552 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00e81bed-4732-4350-bae9-f28122f411bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:57.897044 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00e81bed-4732-4350-bae9-f28122f411bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:15:57.898549 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-00e81bed-4732-4350-bae9-f28122f411bc admin admin] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0909824 Nov 18 18:16:00.149828 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 34480) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:16:00.235000 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26aad5dd-bbf0-44ca-a546-663d8fa5d36e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:16:00.236332 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-26aad5dd-bbf0-44ca-a546-663d8fa5d36e admin admin] 10.222.0.82 "GET /v2.0/subnets/27c45147-26a4-4b40-9fdf-2f6fc0a394bf HTTP/1.1" status: 200 len: 816 time: 0.0855894 Nov 18 18:16:02.490365 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 34490) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:16:02.583371 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34b7bb50-3198-43fd-b9f8-93ecdf5fe664 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:16:02.584756 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-34b7bb50-3198-43fd-b9f8-93ecdf5fe664 admin admin] 10.222.0.82 "GET /v2.0/subnets/c06ab8d6-2e14-4726-90d8-5a943a31695d HTTP/1.1" status: 200 len: 868 time: 0.0934150 Nov 18 18:16:03.972732 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bbbf7acc-45c0-4f96-86b1-e986e8f6bec9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:06.402267 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-c9cac883-15e7-46cc-a557-f4cf7d0e262e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:07.651012 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:08.986427 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:10.140571 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:26.496190 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 5 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:16:26.743386 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 34544) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:16:26.790406 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [None req-17e28075-c2eb-4edd-86b9-9ad3e4f5a03f admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:16:26.791407 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-17e28075-c2eb-4edd-86b9-9ad3e4f5a03f admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0470414 Nov 18 18:16:29.150230 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 34552) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:16:29.211468 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.pecan_wsgi.hooks.translation [None req-3187a3d1-c2fd-4094-af95-a3e85d9c43cd admin admin] GET failed (client error): The resource could not be found. Nov 18 18:16:29.212802 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-3187a3d1-c2fd-4094-af95-a3e85d9c43cd admin admin] 10.222.0.82 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0616448 Nov 18 18:16:29.352665 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f02d1ee-f402-4812-84db-3916f6b8f4c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:16:29.354045 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-5f02d1ee-f402-4812-84db-3916f6b8f4c9 admin admin] 10.222.0.82 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1367936 Nov 18 18:16:31.637131 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34560) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:16:31.683753 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] Request body: {'network': {'shared': True, 'admin_state_up': True, 'name': 'shared'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:16:31.712743 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] Made reservation on behalf of d5fcab64311d4a38a70ce00e512474fc for: {'network': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:16:31.718967 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:31.759267 dv-cinder-787764-6-iscsi neutron-server[102688]: WARNING neutron.services.revisions.revision_plugin [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] Could not find related network for resource to bump revision. Nov 18 18:16:31.772345 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1320} {{(pid=102688) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:16:31.827480 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:31.827827 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.segments_db [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] Added segment b61c9483-d3e6-44f4-9b6d-859c2fd0b703 of type vlan for network 91915bce-58a8-4d07-8162-223eca50fa5c Nov 18 18:16:31.866888 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:31.891060 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:31.892032 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:16:31.892638 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:31.924766 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 848 time: 0.2865832 Nov 18 18:16:31.954717 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b77a34-804e-4796-9991-5cf825d06998 admin admin] Pushing event updated for resources: {'Network': ['ID=91915bce-58a8-4d07-8162-223eca50fa5c,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:16:31.966332 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network 91915bce-58a8-4d07-8162-223eca50fa5c details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:16:33.979378 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9e36a42b-9297-4ac5-a94b-84ad7f4d657b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:34.229304 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34568) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:16:34.288739 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.pecan_wsgi.hooks.translation [None req-8911b34a-0610-4c61-bfea-26943dd3a728 admin admin] GET failed (client error): The resource could not be found. Nov 18 18:16:34.290007 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-8911b34a-0610-4c61-bfea-26943dd3a728 admin admin] 10.222.0.82 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0596910 Nov 18 18:16:34.361976 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a22c769e-e9d1-450e-8cbc-1bb5f1ac2d91 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:16:34.363458 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a22c769e-e9d1-450e-8cbc-1bb5f1ac2d91 admin admin] 10.222.0.82 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 827 time: 0.0689647 Nov 18 18:16:34.373559 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-0555faed-6098-4b33-83f3-31fb6d88ba60 admin admin] Request body: {'subnet': {'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c', 'description': 'shared-subnet', 'ip_version': 4, 'name': 'shared-subnet', 'cidr': '192.168.233.0/24'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:16:34.394093 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0555faed-6098-4b33-83f3-31fb6d88ba60 admin admin] Made reservation on behalf of d5fcab64311d4a38a70ce00e512474fc for: {'subnet': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:16:34.396715 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0555faed-6098-4b33-83f3-31fb6d88ba60 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:34.559260 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0555faed-6098-4b33-83f3-31fb6d88ba60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:34.616810 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0555faed-6098-4b33-83f3-31fb6d88ba60 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5272349c-eb4d-440c-8d7e-450aec9b1220,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:16:34.620995 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0555faed-6098-4b33-83f3-31fb6d88ba60 admin admin] Checking segment: {'id': 'b61c9483-d3e6-44f4-9b6d-859c2fd0b703', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:16:34.621353 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0555faed-6098-4b33-83f3-31fb6d88ba60 admin admin] Network hostable DHCP agents. Network: 91915bce-58a8-4d07-8162-223eca50fa5c, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102688) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:16:34.636971 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0555faed-6098-4b33-83f3-31fb6d88ba60 admin admin] Network 91915bce-58a8-4d07-8162-223eca50fa5c is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102688) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:16:34.644962 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-0555faed-6098-4b33-83f3-31fb6d88ba60 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, 91915bce-58a8-4d07-8162-223eca50fa5c) {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:16:34.649352 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0555faed-6098-4b33-83f3-31fb6d88ba60 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:16:34.649945 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0555faed-6098-4b33-83f3-31fb6d88ba60 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:34.654478 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d960a8d5-4b37-40b5-b0cc-0a6e94587707 None None] Network 91915bce-58a8-4d07-8162-223eca50fa5c requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:16:34.679960 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-0555faed-6098-4b33-83f3-31fb6d88ba60 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.2983067 Nov 18 18:16:34.805152 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc1c763e3-2102-51f8-97fe-c751e57774c1-91915bce-58a8-4d07-8162-223eca50fa5c', 'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c', 'tenant_id': 'd5fcab64311d4a38a70ce00e512474fc', 'fixed_ips': [{'subnet_id': '5272349c-eb4d-440c-8d7e-450aec9b1220'}]}} from dv-cinder-787764-6-iscsi. {{(pid=102690) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 18:16:34.806064 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:34.940758 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.db_base_plugin_common [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Allocated IP 192.168.233.2 (91915bce-58a8-4d07-8162-223eca50fa5c/5272349c-eb4d-440c-8d7e-450aec9b1220/b07a43d7-1f5d-493c-9e60-b313276a3563) {{(pid=102690) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:16:35.174137 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Publish callbacks [] for port, precommit_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:35.180139 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:35.220919 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Network 91915bce-58a8-4d07-8162-223eca50fa5c is already hosted by enough agents. {{(pid=102690) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:16:35.222222 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.base_scheduler [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Resources bound (agent type, host, resource id): {{(pid=102690) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:16:35.225752 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Received port after_create {{(pid=102690) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:16:35.236395 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Pushing event updated for resources: {'Port': ['ID=b07a43d7-1f5d-493c-9e60-b313276a3563,revision_number=1']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:16:35.258521 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:16:35.258875 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:16:35.259227 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:16:35.259568 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:16:35.259907 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:16:35.260270 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:16:35.260602 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:16:35.260941 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:16:35.261273 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:16:35.261603 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:16:35.261930 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:16:35.262253 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:16:35.296723 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Attempting to bind port b07a43d7-1f5d-493c-9e60-b313276a3563 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:16:35.296723 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Attempting to bind port b07a43d7-1f5d-493c-9e60-b313276a3563 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': 'b61c9483-d3e6-44f4-9b6d-859c2fd0b703', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:16:35.297186 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Attempting to bind port b07a43d7-1f5d-493c-9e60-b313276a3563 on network 91915bce-58a8-4d07-8162-223eca50fa5c {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:16:35.302181 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 16, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:16:35.302559 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Checking segment: {'id': 'b61c9483-d3e6-44f4-9b6d-859c2fd0b703', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:16:35.302966 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:35.303888 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Bound using segment: {'id': 'b61c9483-d3e6-44f4-9b6d-859c2fd0b703', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:16:35.304391 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Bound port: b07a43d7-1f5d-493c-9e60-b313276a3563, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b61c9483-d3e6-44f4-9b6d-859c2fd0b703', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:16:35.304789 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:35.366557 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] For port b07a43d7-1f5d-493c-9e60-b313276a3563, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:16:35.370029 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] For port b07a43d7-1f5d-493c-9e60-b313276a3563, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=b07a43d7-1f5d-493c-9e60-b313276a3563,segment=NetworkSegment(b61c9483-d3e6-44f4-9b6d-859c2fd0b703),segment_id=b61c9483-d3e6-44f4-9b6d-859c2fd0b703)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:16:35.375513 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:35.436919 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87e1ed78-124e-41ef-a923-c4047a995a46 None None] Pushing event updated for resources: {'Port': ['ID=b07a43d7-1f5d-493c-9e60-b313276a3563,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:16:35.950411 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device b07a43d7-1f5d-493c-9e60-b313276a3563 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:16:36.003400 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port b07a43d7-1f5d-493c-9e60-b313276a3563 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:16:36.003774 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:36.090742 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:36.136598 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port b07a43d7-1f5d-493c-9e60-b313276a3563, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=b07a43d7-1f5d-493c-9e60-b313276a3563,segment=NetworkSegment(b61c9483-d3e6-44f4-9b6d-859c2fd0b703),segment_id=b61c9483-d3e6-44f4-9b6d-859c2fd0b703)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:16:36.141847 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:36.196732 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=b07a43d7-1f5d-493c-9e60-b313276a3563,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:16:36.301962 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-123e813a-111d-4e70-88d1-d106c68cd4cb None None] Network 91915bce-58a8-4d07-8162-223eca50fa5c requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:16:36.401919 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-a2b212ac-7379-4204-ae29-e1451f037263 None None] Provisioning complete for port b07a43d7-1f5d-493c-9e60-b313276a3563 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:16:36.402293 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a2b212ac-7379-4204-ae29-e1451f037263 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:36.447114 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-855fcb01-9a2e-44b7-a88a-1938eeca3a05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:36.766909 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-d33e283e-524c-4dff-a994-5f2af9a283d0 None None] Provisioning complete for port b07a43d7-1f5d-493c-9e60-b313276a3563 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:16:36.767283 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d33e283e-524c-4dff-a994-5f2af9a283d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:37.656896 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:37.937978 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device b07a43d7-1f5d-493c-9e60-b313276a3563 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:16:37.986986 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port b07a43d7-1f5d-493c-9e60-b313276a3563 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:16:37.987347 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:38.992416 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:16:40.143649 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:03.495265 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 5 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:17:03.971786 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-565e3acb-e4ea-4a20-91ad-078584f97619 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:06.400858 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-66dcab4d-f40e-46a6-ac83-9bd209675f1a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:07.657095 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:08.993084 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:10.146766 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:33.974019 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-46a2f2a2-7e53-452e-95b5-dc139c8479f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:36.402502 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d1f8f2bb-01e3-4e38-9431-e6af2d326533 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:37.658691 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:38.996243 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:40.148333 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:40.493371 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 5 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:17:45.657463 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 34612) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:17:45.663275 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [None req-4c644f3e-f4f4-45d4-9851-79dafa79e1a7 tempest-verify_tempest_config-2118457244 tempest-verify_tempest_config-2118457244-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:17:45.664261 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-4c644f3e-f4f4-45d4-9851-79dafa79e1a7 tempest-verify_tempest_config-2118457244 tempest-verify_tempest_config-2118457244-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0058205 Nov 18 18:17:45.945070 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 34630) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:17:46.046137 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:46.117814 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:46.121433 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:46.165989 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ef744ef1ee12484696a40ad3a3d2ba59&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2198749 Nov 18 18:17:46.166832 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=150c152a-cf7a-480d-9b2d-60ba4767869a,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:17:46.168671 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34634) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:17:46.173532 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.173889 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.174236 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.174575 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.174918 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.175299 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.176169 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.176505 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.176835 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.177166 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.177493 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.177817 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7469db9-6a20-430d-9b72-c348a4756c60 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.225744 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:46.246358 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:46.337309 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:46.339879 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:17:46.341047 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/150c152a-cf7a-480d-9b2d-60ba4767869a HTTP/1.1" status: 204 len: 168 time: 0.1713450 Nov 18 18:17:46.350117 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=150c152a-cf7a-480d-9b2d-60ba4767869a,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:17:46.356615 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.357003 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.357361 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.357698 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.358039 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.358400 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.358750 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.359131 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.359414 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.359746 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.360106 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:17:46.360438 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94745542-dbb4-4134-8b60-62510047ef7b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:18:03.975693 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-fcb8abc7-1efe-4934-8eb5-81642439b9a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:18:06.410427 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f4c10e8b-72da-42c2-be2d-07cc53be8a98 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:18:07.662263 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:18:08.998589 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:18:10.149689 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:18:17.491766 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 5 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:18:33.978106 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-8439c443-f0c4-4dfb-b4e3-f25d1d4a889b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:18:36.402621 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-88db8093-150c-43d2-b28c-b0d8bb2d3f3a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:18:37.664934 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:18:39.002328 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:18:40.151623 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:18:54.489472 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 5 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:19:03.979096 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-55594400-36b4-4685-a0fa-10dbd15d513b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:19:06.402772 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a98fa86f-ecfb-40a7-a147-585fec129f8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:19:07.668537 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:19:09.005053 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:19:10.155263 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:19:20.985991 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-432076'] for agent, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:19:31.488804 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:19:33.981244 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e3f06707-1468-40b8-a263-d57606a8618c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:19:35.948701 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34710) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:19:36.050607 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-0ac14a6e-db9f-495c-ae1a-7b57b2eedda3 admin admin] 10.222.0.82 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1008115 Nov 18 18:19:36.405164 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-6f30e26b-8f52-42a1-9469-f641c6c2ed66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:19:37.673669 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:19:38.317991 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34720) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:19:38.371269 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a560d759-ae74-4269-9335-168a257ef6fc admin admin] 10.222.0.82 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0521665 Nov 18 18:19:39.009325 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:19:40.157040 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:19:50.957113 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:20:03.982157 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-73324774-5c01-4dba-a9d5-7e3c230ea013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:20:06.406927 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-cc47c1c1-4a95-4387-a0ac-90651e82e5f1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:20:07.677192 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:20:08.488098 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:20:09.012613 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:20:10.160032 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:20:20.957705 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:20:33.996639 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-86e0112b-0e31-4278-a4b6-448aa081d2c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:20:36.408117 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9e990db0-c8fc-46c9-a47c-08ee8c2b314b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:20:37.678814 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:20:39.016405 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:20:40.165537 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:20:45.486483 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:20:50.973636 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:03.979012 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d3afc462-e4ef-4b9c-bf48-b462ab5dfe3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:06.430625 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9e67aa20-b3a6-4797-98d0-ea60e81fed3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:07.711824 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.010070 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34820) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:08.194441 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-network', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:08.218011 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Made reservation on behalf of 6a79674a70ee4ad7acedc7d4896b413e for: {'network': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:08.220556 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.231278 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.310605 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.316363 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.344306 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=880a9af6-6df3-43c8-a35e-68211a1c5c1b,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:08.355173 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.356363 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.356865 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.357555 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.357860 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.358336 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.358694 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.359075 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.359440 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.359961 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.360469 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.360970 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Tracked resource versions report: Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: pushed versions: Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: { 'AddressGroup': {'1.2'}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'ConntrackHelper': {'1.0'}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Log': {'1.0'}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Network': {'1.1'}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Port': {'1.7'}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'PortForwarding': {'1.2'}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'QosPolicy': {'1.10'}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'SecurityGroup': {'1.5'}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'SecurityGroupRule': {'1.2'}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'SubPort': {'1.0'}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Subnet': {'1.1'}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Trunk': {'1.1'}} Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: consumer versions: Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: { DHCP agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: HyperV agent@hv-cinder-78776: {}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: L3 agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: Metadata agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: Metering agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: Open vSwitch agent@dv-cinder-787764-6-iscsi: { 'AddressGroup': '1.2', Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'ConntrackHelper': '1.0', Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Log': '1.0', Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Network': '1.1', Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Port': '1.7', Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'PortForwarding': '1.2', Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'QosPolicy': '1.10', Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'SecurityGroup': '1.5', Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'SecurityGroupRule': '1.2', Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'SubPort': '1.0', Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Subnet': '1.1', Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: 'Trunk': '1.1'}} Nov 18 18:21:08.363095 dv-cinder-787764-6-iscsi neutron-server[102688]: {{(pid=102688) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 18:21:08.391437 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1342} {{(pid=102688) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:21:08.405423 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.405993 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.segments_db [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Added segment 8eec1f1e-2e54-42fa-aa94-4d0a1a513db5 of type vlan for network d845755f-6a59-4935-8123-1a70c6e45968 Nov 18 18:21:08.448817 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.481547 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.482508 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:08.483150 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.523408 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 0.5111825 Nov 18 18:21:08.526479 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 34868) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:08.537086 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Request body: {'subnet': {'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-subnet', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:08.551631 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95d04d3a-df1c-4261-9084-fa75f3b1f4d9 admin admin] Pushing event updated for resources: {'Network': ['ID=d845755f-6a59-4935-8123-1a70c6e45968,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:08.564614 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Made reservation on behalf of 6a79674a70ee4ad7acedc7d4896b413e for: {'subnet': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:08.573638 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.583301 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network d845755f-6a59-4935-8123-1a70c6e45968 details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:21:08.757561 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.801420 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=690618f7-2d23-41bc-866f-0d343d1149d2,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:08.809250 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.809821 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.810170 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.810868 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.811004 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.811322 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.811779 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.812146 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.812552 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.812938 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.813588 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.813714 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Tracked resource versions report: Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: pushed versions: Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: { 'AddressGroup': {'1.2'}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'ConntrackHelper': {'1.0'}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Log': {'1.0'}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Network': {'1.1'}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Port': {'1.7'}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'PortForwarding': {'1.2'}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'QosPolicy': {'1.10'}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'SecurityGroup': {'1.5'}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'SecurityGroupRule': {'1.2'}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'SubPort': {'1.0'}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Subnet': {'1.1'}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Trunk': {'1.1'}} Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: consumer versions: Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: { DHCP agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: HyperV agent@hv-cinder-78776: {}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: L3 agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: Metadata agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: Metering agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: Open vSwitch agent@dv-cinder-787764-6-iscsi: { 'AddressGroup': '1.2', Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'ConntrackHelper': '1.0', Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Log': '1.0', Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Network': '1.1', Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Port': '1.7', Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'PortForwarding': '1.2', Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'QosPolicy': '1.10', Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'SecurityGroup': '1.5', Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'SecurityGroupRule': '1.2', Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'SubPort': '1.0', Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Subnet': '1.1', Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: 'Trunk': '1.1'}} Nov 18 18:21:08.815045 dv-cinder-787764-6-iscsi neutron-server[102689]: {{(pid=102689) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 18:21:08.843684 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Checking segment: {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:08.844060 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Network hostable DHCP agents. Network: d845755f-6a59-4935-8123-1a70c6e45968, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102689) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:21:08.862900 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Network d845755f-6a59-4935-8123-1a70c6e45968 is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102689) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:21:08.874365 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, d845755f-6a59-4935-8123-1a70c6e45968) {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:08.878659 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:08.879685 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.885647 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc6b1034-5f5a-4fec-aee8-d22871f59209 None None] Network d845755f-6a59-4935-8123-1a70c6e45968 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:21:08.896944 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-0d3d0dd6-2ebe-4ac7-96af-4a02bcc341f5 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.3688068 Nov 18 18:21:08.899742 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34882) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:08.904256 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:08.937535 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-430558', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-543'] for router, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:08.939552 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-430410', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-500004', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1631324', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-534'] for router, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.056719 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.067149 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc1c763e3-2102-51f8-97fe-c751e57774c1-d845755f-6a59-4935-8123-1a70c6e45968', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2'}]}} from dv-cinder-787764-6-iscsi. {{(pid=102690) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 18:21:09.068059 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.087567 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.227231 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.db_base_plugin_common [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Allocated IP 172.20.0.2 (d845755f-6a59-4935-8123-1a70c6e45968/690618f7-2d23-41bc-866f-0d343d1149d2/97c831a7-d8cf-4603-8659-4d1b9fd72141) {{(pid=102690) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:09.256330 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 34900) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:09.308017 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.393783 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Publish callbacks [] for port, precommit_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.404171 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.468879 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Network d845755f-6a59-4935-8123-1a70c6e45968 is already hosted by enough agents. {{(pid=102690) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:09.472285 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.base_scheduler [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Resources bound (agent type, host, resource id): {{(pid=102690) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:09.474967 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Received port after_create {{(pid=102690) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:09.486874 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Pushing event updated for resources: {'Port': ['ID=97c831a7-d8cf-4603-8659-4d1b9fd72141,revision_number=1']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:09.521436 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:09.522009 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:09.523054 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:09.523551 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:09.524098 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:09.524604 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:09.525507 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:09.525996 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:09.526492 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:09.526977 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:09.527477 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:09.528261 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Tracked resource versions report: Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: pushed versions: Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: { 'AddressGroup': {'1.2'}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'ConntrackHelper': {'1.0'}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Log': {'1.0'}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Network': {'1.1'}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Port': {'1.7'}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'PortForwarding': {'1.2'}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'QosPolicy': {'1.10'}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'SecurityGroup': {'1.5'}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'SecurityGroupRule': {'1.2'}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'SubPort': {'1.0'}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Subnet': {'1.1'}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Trunk': {'1.1'}} Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: consumer versions: Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: { DHCP agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: HyperV agent@hv-cinder-78776: {}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: L3 agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: Metadata agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: Metering agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: Open vSwitch agent@dv-cinder-787764-6-iscsi: { 'AddressGroup': '1.2', Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'ConntrackHelper': '1.0', Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Log': '1.0', Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Network': '1.1', Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Port': '1.7', Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'PortForwarding': '1.2', Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'QosPolicy': '1.10', Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'SecurityGroup': '1.5', Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'SecurityGroupRule': '1.2', Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'SubPort': '1.0', Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Subnet': '1.1', Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: 'Trunk': '1.1'}} Nov 18 18:21:09.530054 dv-cinder-787764-6-iscsi neutron-server[102690]: {{(pid=102690) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 18:21:09.544834 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1907564313-network', 'tenant_id': '83eb53a057ad4d528a3e2875be10dd97'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:09.566241 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Attempting to bind port 97c831a7-d8cf-4603-8659-4d1b9fd72141 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:09.566922 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Attempting to bind port 97c831a7-d8cf-4603-8659-4d1b9fd72141 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:09.567468 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Attempting to bind port 97c831a7-d8cf-4603-8659-4d1b9fd72141 on network d845755f-6a59-4935-8123-1a70c6e45968 {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:09.580385 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 20, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:09.580966 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Checking segment: {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:09.581532 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.582091 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Bound using segment: {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:09.582730 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Bound port: 97c831a7-d8cf-4603-8659-4d1b9fd72141, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:09.583721 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.587443 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Made reservation on behalf of 83eb53a057ad4d528a3e2875be10dd97 for: {'network': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:09.589282 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.589636 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.598424 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.626875 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.677773 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] For port 97c831a7-d8cf-4603-8659-4d1b9fd72141, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:09.678217 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.682802 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] For port 97c831a7-d8cf-4603-8659-4d1b9fd72141, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=97c831a7-d8cf-4603-8659-4d1b9fd72141,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:09.684869 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.688447 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.739344 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd92f142-962d-42fa-b4d8-43c5f7b2b04a,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:09.756269 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1340} {{(pid=102689) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:21:09.783612 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.784092 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.segments_db [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Added segment 75f5638d-c7c3-4b9a-9271-1a7bc4fecb74 of type vlan for network 7e134455-4777-4316-bbbd-bb2480fdc6bf Nov 18 18:21:09.792298 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d44ef70-f2fa-47ae-96de-da6f30b0776e None None] Pushing event updated for resources: {'Port': ['ID=97c831a7-d8cf-4603-8659-4d1b9fd72141,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:09.851614 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.908170 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.909418 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:09.910264 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:09.955627 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Allocated IP 172.27.1.146 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:09.959136 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.7015774 Nov 18 18:21:09.962590 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 34928) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:09.970273 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-16be8b35-c60e-4d56-b49a-35fb12ca1c16 admin admin] Request body: {'subnet': {'network_id': '7e134455-4777-4316-bbbd-bb2480fdc6bf', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1907564313-subnet', 'tenant_id': '83eb53a057ad4d528a3e2875be10dd97', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:10.002928 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16be8b35-c60e-4d56-b49a-35fb12ca1c16 admin admin] Made reservation on behalf of 83eb53a057ad4d528a3e2875be10dd97 for: {'subnet': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:10.006637 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-16be8b35-c60e-4d56-b49a-35fb12ca1c16 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:10.130659 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc36e075-e275-49e0-929d-880420457ac3 admin admin] Pushing event updated for resources: {'Network': ['ID=7e134455-4777-4316-bbbd-bb2480fdc6bf,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:10.131518 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network 7e134455-4777-4316-bbbd-bb2480fdc6bf details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:21:10.190992 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:10.318612 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-16be8b35-c60e-4d56-b49a-35fb12ca1c16 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:10.326406 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:10.355305 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:10.414695 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16be8b35-c60e-4d56-b49a-35fb12ca1c16 admin admin] Checking segment: {'id': '75f5638d-c7c3-4b9a-9271-1a7bc4fecb74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1340, 'network_id': '7e134455-4777-4316-bbbd-bb2480fdc6bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:10.415060 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16be8b35-c60e-4d56-b49a-35fb12ca1c16 admin admin] Network hostable DHCP agents. Network: 7e134455-4777-4316-bbbd-bb2480fdc6bf, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102689) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:21:10.437918 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16be8b35-c60e-4d56-b49a-35fb12ca1c16 admin admin] Pushing event updated for resources: {'Subnet': ['ID=487bf315-c9f3-4691-b915-cf15db298f82,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:10.446751 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 34940) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:10.454357 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Pushing event updated for resources: {'Port': ['ID=5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:10.465656 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16be8b35-c60e-4d56-b49a-35fb12ca1c16 admin admin] Network 7e134455-4777-4316-bbbd-bb2480fdc6bf is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102689) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:21:10.470201 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:10.471610 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:10.474229 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:10.482165 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-16be8b35-c60e-4d56-b49a-35fb12ca1c16 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, 7e134455-4777-4316-bbbd-bb2480fdc6bf) {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:10.491308 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2660d2e7-9bfe-4d13-b42c-33a23c333319 None None] Network 7e134455-4777-4316-bbbd-bb2480fdc6bf requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:21:10.493646 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16be8b35-c60e-4d56-b49a-35fb12ca1c16 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:10.494245 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-16be8b35-c60e-4d56-b49a-35fb12ca1c16 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:10.500885 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 34946) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:10.541888 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-16be8b35-c60e-4d56-b49a-35fb12ca1c16 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.5680025 Nov 18 18:21:10.606770 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 34952) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:10.669650 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-204cff58-bf70-4750-803f-d99dad883a1a None None] Network 7e134455-4777-4316-bbbd-bb2480fdc6bf requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:21:10.849384 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1249927654-network', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:10.886609 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Made reservation on behalf of 76c33c7e96d748ee9e7cdd35c33082fa for: {'network': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:10.889387 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:10.916825 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:10.922208 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1981776663-network', 'tenant_id': 'eed6400cd0414bc5a520c9886c2a4bde'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:10.927492 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:10.982129 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-970776786-network', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:10.996897 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Made reservation on behalf of eed6400cd0414bc5a520c9886c2a4bde for: {'network': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:11.004253 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.031902 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Made reservation on behalf of 1bab99f3344342578dc7b1c29b1ced7e for: {'network': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:11.034348 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.038689 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.061049 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.176137 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.190444 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.193015 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d931123-f16e-4a69-a947-666e1d21887c None None] Network d845755f-6a59-4935-8123-1a70c6e45968 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:21:11.221514 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1343} {{(pid=102689) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:21:11.253127 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-430421', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-500439'] for router, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.258812 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5863b35d-efcf-4c6a-af3b-35250e4eb224,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:11.273255 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.273694 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.segments_db [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Added segment fc75aa15-d703-4ab9-a6cc-28e47f3895ec of type vlan for network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 Nov 18 18:21:11.315866 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.324179 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-3f094f7b-8377-4a9c-810e-55859c96e643 None None] Provisioning complete for port 97c831a7-d8cf-4603-8659-4d1b9fd72141 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:11.324837 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3f094f7b-8377-4a9c-810e-55859c96e643 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.360201 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.372664 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1303} {{(pid=102689) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:21:11.401251 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.401592 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.segments_db [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Added segment 2ba9981f-6a4d-4618-9c8c-84315de87d1c of type vlan for network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 Nov 18 18:21:11.410826 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.423758 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.451004 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.489475 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3f094f7b-8377-4a9c-810e-55859c96e643 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.518081 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:11.529280 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1348} {{(pid=102689) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:21:11.533521 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.540390 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-3f094f7b-8377-4a9c-810e-55859c96e643 None None] For port 97c831a7-d8cf-4603-8659-4d1b9fd72141, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=97c831a7-d8cf-4603-8659-4d1b9fd72141,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:11.546015 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.547018 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:11.547598 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.548375 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3f094f7b-8377-4a9c-810e-55859c96e643 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.636359 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] Pushing event updated for resources: {'Network': ['ID=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:11.638907 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.639427 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.segments_db [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Added segment b2f6a54f-52ed-4860-8d6c-6ee082b77b95 of type vlan for network f2a08e65-1c6c-43fe-a019-78643e62bd9f Nov 18 18:21:11.645243 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f094f7b-8377-4a9c-810e-55859c96e643 None None] Pushing event updated for resources: {'Port': ['ID=97c831a7-d8cf-4603-8659-4d1b9fd72141,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:11.657048 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:21:11.667962 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-320ed142-82b1-4eee-8bba-196a7f7010c9 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 1.2201548 Nov 18 18:21:11.671420 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 34998) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:11.671849 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.db.resource_extend [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 18 18:21:11.682353 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-f9480a24-5177-4821-99d5-0cad14718891 admin admin] Request body: {'subnet': {'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1249927654-subnet', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:11.729783 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Router 5f928fdc-791e-4821-b088-039c140695e9 is scheduled to L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 with binding_index 1 {{(pid=102688) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 18:21:11.739536 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de2b0a73-6c00-439d-bfca-0151cdce9d19,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:11.763502 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f9480a24-5177-4821-99d5-0cad14718891 admin admin] Made reservation on behalf of 76c33c7e96d748ee9e7cdd35c33082fa for: {'subnet': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:11.765907 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f9480a24-5177-4821-99d5-0cad14718891 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.783524 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.786125 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.788595 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:11.789622 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.881636 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] Pushing event updated for resources: {'Network': ['ID=14ac84aa-8c04-4323-8592-aecfbb5a7fe1,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:11.894299 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:21:11.897087 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-0d5596de-32af-4303-9a94-1e88d2ad8023 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 1.3951809 Nov 18 18:21:11.900537 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35006) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:11.906524 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-bc1a018f-9c0d-4511-b978-6071a7c9aa5f admin admin] Request body: {'subnet': {'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1981776663-subnet', 'tenant_id': 'eed6400cd0414bc5a520c9886c2a4bde', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:11.911477 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.db.resource_extend [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 18 18:21:11.954370 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:11.956522 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:11.958096 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:12.136272 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] Pushing event updated for resources: {'Network': ['ID=f2a08e65-1c6c-43fe-a019-78643e62bd9f,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:12.152048 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bc1a018f-9c0d-4511-b978-6071a7c9aa5f admin admin] Made reservation on behalf of eed6400cd0414bc5a520c9886c2a4bde for: {'subnet': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:12.153986 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-988d210f-4e01-4078-9461-3a1798eb4359 None None] Provisioning complete for port 97c831a7-d8cf-4603-8659-4d1b9fd72141 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:12.154365 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-988d210f-4e01-4078-9461-3a1798eb4359 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:12.155551 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc1a018f-9c0d-4511-b978-6071a7c9aa5f admin admin] Publish callbacks [] for subnet, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:12.158511 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network f2a08e65-1c6c-43fe-a019-78643e62bd9f details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:21:12.229495 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-4887a546-47ab-4021-932a-34f703b09b08 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.6217182 Nov 18 18:21:12.244217 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35014) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:12.251955 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 97c831a7-d8cf-4603-8659-4d1b9fd72141 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:12.261557 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-f854a7cb-13ee-4f6f-a314-2b9af482b464 admin admin] Request body: {'subnet': {'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-970776786-subnet', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:12.315635 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f9480a24-5177-4821-99d5-0cad14718891 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:12.369848 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9480a24-5177-4821-99d5-0cad14718891 admin admin] Pushing event updated for resources: {'Subnet': ['ID=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:12.383216 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 97c831a7-d8cf-4603-8659-4d1b9fd72141 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:12.383586 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:12.414020 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:21:12.427055 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Sync routers for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:21:12.449194 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:21:12.452323 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:12.475750 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9480a24-5177-4821-99d5-0cad14718891 admin admin] Checking segment: {'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:12.487977 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9480a24-5177-4821-99d5-0cad14718891 admin admin] Network hostable DHCP agents. Network: 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102688) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:21:12.539978 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9480a24-5177-4821-99d5-0cad14718891 admin admin] Network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102688) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:21:12.563385 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-f9480a24-5177-4821-99d5-0cad14718891 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38) {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:12.576488 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9480a24-5177-4821-99d5-0cad14718891 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:12.577096 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f9480a24-5177-4821-99d5-0cad14718891 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:12.577294 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d20bc168-19f8-4fc8-a538-30187a93d122 None None] Network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:21:12.668349 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f854a7cb-13ee-4f6f-a314-2b9af482b464 admin admin] Made reservation on behalf of 1bab99f3344342578dc7b1c29b1ced7e for: {'subnet': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:12.677267 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] Publish callbacks [] for router, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:12.679667 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-8c5486bc-4c45-46b5-941d-409d01362949 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 3.7782030 Nov 18 18:21:12.688312 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-f9480a24-5177-4821-99d5-0cad14718891 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 1.0153189 Nov 18 18:21:12.689270 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f854a7cb-13ee-4f6f-a314-2b9af482b464 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:12.704520 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35044) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:12.708117 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35046) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:12.741957 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1249927654-router', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:12.859201 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:21:12.889196 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3ed3951-5832-4e56-8323-b237fb428f3f None None] Network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:21:13.135198 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35094) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:13.149390 dv-cinder-787764-6-iscsi neutron-server[102689]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 18 18:21:13.291046 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc1a018f-9c0d-4511-b978-6071a7c9aa5f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:13.300567 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:10Z', 'revision_number': 3, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:13.356807 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Checking router: 5f928fdc-791e-4821-b088-039c140695e9 for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:21:13.357169 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Updating router 5f928fdc-791e-4821-b088-039c140695e9 port 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 binding host dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:21:13.391079 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-430558', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-543'] for router, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:13.392588 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc1a018f-9c0d-4511-b978-6071a7c9aa5f admin admin] Pushing event updated for resources: {'Subnet': ['ID=488ef4e4-e6f9-414a-b93f-aabd7b232f9e,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:13.393272 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-430410', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-500004', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1631324', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-534'] for router, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:13.402263 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:13.508644 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:13.678496 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35112) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:13.721540 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Publish callbacks [] for port, precommit_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:13.730551 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:13.739992 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-811ff932-c342-456a-a9e6-a7b4c34368bd tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:13.742672 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-811ff932-c342-456a-a9e6-a7b4c34368bd tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/networks?id=7e134455-4777-4316-bbbd-bb2480fdc6bf HTTP/1.1" status: 200 len: 812 time: 0.6065183 Nov 18 18:21:13.757646 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f854a7cb-13ee-4f6f-a314-2b9af482b464 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:13.763520 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc1a018f-9c0d-4511-b978-6071a7c9aa5f admin admin] Checking segment: {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:13.764124 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc1a018f-9c0d-4511-b978-6071a7c9aa5f admin admin] Network hostable DHCP agents. Network: 14ac84aa-8c04-4323-8592-aecfbb5a7fe1, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102689) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:21:13.767767 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35114) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:13.785206 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Pushing event updated for resources: {'Port': ['ID=5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2,revision_number=2']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:13.798525 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:13.798906 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:13.799258 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:13.799598 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:13.799952 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:13.800317 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:13.800852 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:13.801188 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:13.801537 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:13.801870 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:13.802201 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:13.802529 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Tracked resource versions report: Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: pushed versions: Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: { 'AddressGroup': {'1.2'}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'ConntrackHelper': {'1.0'}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Log': {'1.0'}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Network': {'1.1'}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Port': {'1.7'}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'PortForwarding': {'1.2'}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'QosPolicy': {'1.10'}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'SecurityGroup': {'1.5'}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'SecurityGroupRule': {'1.2'}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'SubPort': {'1.0'}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Subnet': {'1.1'}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Trunk': {'1.1'}} Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: consumer versions: Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: { DHCP agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: HyperV agent@hv-cinder-78776: {}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: L3 agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: Metadata agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: Metering agent@dv-cinder-787764-6-iscsi: {}, Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: Open vSwitch agent@dv-cinder-787764-6-iscsi: { 'AddressGroup': '1.2', Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'ConntrackHelper': '1.0', Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Log': '1.0', Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Network': '1.1', Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Port': '1.7', Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'PortForwarding': '1.2', Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'QosPolicy': '1.10', Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'SecurityGroup': '1.5', Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'SecurityGroupRule': '1.2', Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'SubPort': '1.0', Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Subnet': '1.1', Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: 'Trunk': '1.1'}} Nov 18 18:21:13.804157 dv-cinder-787764-6-iscsi neutron-server[102691]: {{(pid=102691) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 18:21:13.811316 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Attempting to bind port 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:13.811882 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Attempting to bind port 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:13.812487 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Attempting to bind port 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 on network 2cab888d-52a8-434c-814e-4f25740decd0 {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:13.818888 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:13.819958 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Checking segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102691) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:13.820378 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:13.820766 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Bound using segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:13.821412 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Bound port: 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:13.821967 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f854a7cb-13ee-4f6f-a314-2b9af482b464 admin admin] Pushing event updated for resources: {'Subnet': ['ID=53535ce7-7c2a-450f-87e4-d092908ff080,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:13.822087 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:13.851822 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-43a8b186-32e5-40f7-ab3c-39020d992fe8 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/quotas/83eb53a057ad4d528a3e2875be10dd97 HTTP/1.1" status: 200 len: 375 time: 0.1011801 Nov 18 18:21:13.884361 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] For port 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102691) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:13.888849 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] For port 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102691) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:13.899967 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:13.901402 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:13.924771 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-8cfe5e5e-6ebf-41a2-9e9f-8e509bae4617 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=83eb53a057ad4d528a3e2875be10dd97&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0660369 Nov 18 18:21:13.930197 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc1a018f-9c0d-4511-b978-6071a7c9aa5f admin admin] Network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102689) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:21:13.948852 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f854a7cb-13ee-4f6f-a314-2b9af482b464 admin admin] Checking segment: {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:13.949483 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f854a7cb-13ee-4f6f-a314-2b9af482b464 admin admin] Network hostable DHCP agents. Network: f2a08e65-1c6c-43fe-a019-78643e62bd9f, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102689) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:21:13.956335 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-bc1a018f-9c0d-4511-b978-6071a7c9aa5f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, 14ac84aa-8c04-4323-8592-aecfbb5a7fe1) {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:13.965193 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05f78add-2f1a-4130-8b5f-303af7c51af4 None None] Network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:21:13.967105 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc1a018f-9c0d-4511-b978-6071a7c9aa5f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:13.967862 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc1a018f-9c0d-4511-b978-6071a7c9aa5f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.016227 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-bc1a018f-9c0d-4511-b978-6071a7c9aa5f admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 2.1133559 Nov 18 18:21:14.018436 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f854a7cb-13ee-4f6f-a314-2b9af482b464 admin admin] Network f2a08e65-1c6c-43fe-a019-78643e62bd9f is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102689) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:21:14.026601 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-f854a7cb-13ee-4f6f-a314-2b9af482b464 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, f2a08e65-1c6c-43fe-a019-78643e62bd9f) {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:14.031592 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f854a7cb-13ee-4f6f-a314-2b9af482b464 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:14.032834 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f854a7cb-13ee-4f6f-a314-2b9af482b464 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.053789 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:21:14.055500 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:14.060651 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8635a81-ac10-45fa-8f8c-9a9576559418 None None] Pushing event updated for resources: {'Port': ['ID=5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2,revision_number=3']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:14.073396 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-f854a7cb-13ee-4f6f-a314-2b9af482b464 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.8256333 Nov 18 18:21:14.074607 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35126) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:14.084799 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:14.092453 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c767a40-cd80-44d9-966d-58575246763a None None] Network f2a08e65-1c6c-43fe-a019-78643e62bd9f requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:21:14.136665 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9d713051-39fa-401e-bb89-02508d82f548 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.189490 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-430558', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-543'] for router, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.190576 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-430410', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-500004', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1631324', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-534'] for router, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.197371 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-efb7245a-3373-40cb-9250-dfd52f4dea29 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.213739 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.220535 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:21:14.307275 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b27d3d46-1e85-4c19-bc20-56b5bbabf587 None None] Network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:21:14.359337 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.367836 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-79499f79-26ae-4d78-83f8-33d9d77cd894 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:21:14.375983 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-79499f79-26ae-4d78-83f8-33d9d77cd894 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1789296 Nov 18 18:21:14.486421 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-74690b5a-334e-4d9a-8d81-82869681de56 service neutron] 10.222.0.82 "GET /v2.0/networks/7e134455-4777-4316-bbbd-bb2480fdc6bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1093495 Nov 18 18:21:14.489739 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:10Z', 'revision_number': 3, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:14.525906 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9520f275-65d6-46da-af5b-fb582980e5f5 None None] The sync data for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi is: [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:10Z', 'revision_number': 3, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:21:14.590904 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc1c763e3-2102-51f8-97fe-c751e57774c1-f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080'}]}} from dv-cinder-787764-6-iscsi. {{(pid=102690) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 18:21:14.591783 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.675989 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-efb7245a-3373-40cb-9250-dfd52f4dea29 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.690447 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9d713051-39fa-401e-bb89-02508d82f548 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.765065 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Allocated IP 172.20.0.1 (d845755f-6a59-4935-8123-1a70c6e45968/690618f7-2d23-41bc-866f-0d343d1149d2/7d6934a0-5c28-4a10-a5e5-fd96332c82b4) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:14.770105 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.db_base_plugin_common [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Allocated IP 172.20.0.2 (f2a08e65-1c6c-43fe-a019-78643e62bd9f/53535ce7-7c2a-450f-87e4-d092908ff080/23788fbf-07af-4ed8-b5ac-3203649e3751) {{(pid=102690) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:14.771039 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35150) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:14.779755 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9d713051-39fa-401e-bb89-02508d82f548 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.943288 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.950017 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:14.966408 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-9d713051-39fa-401e-bb89-02508d82f548 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f67f07a363134f6d8433123e4ec3fad9&name=default HTTP/1.1" status: 200 len: 2992 time: 1.1531811 Nov 18 18:21:14.967127 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35154) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:14.996498 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Publish callbacks [] for port, precommit_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.014139 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.017613 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-efb7245a-3373-40cb-9250-dfd52f4dea29 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.084916 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Network f2a08e65-1c6c-43fe-a019-78643e62bd9f is already hosted by enough agents. {{(pid=102690) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:15.102745 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Pushing event updated for resources: {'Port': ['ID=23788fbf-07af-4ed8-b5ac-3203649e3751,revision_number=1']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:15.103044 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.105842 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.base_scheduler [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Resources bound (agent type, host, resource id): {{(pid=102690) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:15.108337 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Received port after_create {{(pid=102690) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:15.108595 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d713051-39fa-401e-bb89-02508d82f548 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4189ab1-b3f8-433f-aa70-34922487d8da,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:15.134912 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-ffde35e4-47a0-477a-a5af-614f726afcdb service neutron] 10.222.0.82 "GET /v2.0/networks/7e134455-4777-4316-bbbd-bb2480fdc6bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6454878 Nov 18 18:21:15.180384 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-efb7245a-3373-40cb-9250-dfd52f4dea29 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ae2ad4017ed64e1982322fe097990e60&name=default HTTP/1.1" status: 200 len: 2992 time: 1.3963003 Nov 18 18:21:15.198340 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35162) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:15.205455 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Attempting to bind port 23788fbf-07af-4ed8-b5ac-3203649e3751 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:15.206477 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Attempting to bind port 23788fbf-07af-4ed8-b5ac-3203649e3751 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:15.206958 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Attempting to bind port 23788fbf-07af-4ed8-b5ac-3203649e3751 on network f2a08e65-1c6c-43fe-a019-78643e62bd9f {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:15.212297 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.221676 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Network d845755f-6a59-4935-8123-1a70c6e45968 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:15.229263 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:15.229643 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Checking segment: {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:15.230058 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.230456 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Bound using segment: {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:15.230953 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Bound port: 23788fbf-07af-4ed8-b5ac-3203649e3751, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:15.231353 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.275022 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:15.279484 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:15.285405 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-500260'] for router_interface, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.287873 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efb7245a-3373-40cb-9250-dfd52f4dea29 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=15af47e9-17dc-40f2-9082-e0f6d4f72f1f,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:15.290784 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.314958 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-5bc34738-04a9-4a4f-b235-9a0dbb5456dd tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:15.316364 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-5bc34738-04a9-4a4f-b235-9a0dbb5456dd tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 815 time: 0.5420046 Nov 18 18:21:15.318376 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7a590f59-8ae8-4805-8b42-9517d4ef317a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.344471 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7a590f59-8ae8-4805-8b42-9517d4ef317a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.357173 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] For port 23788fbf-07af-4ed8-b5ac-3203649e3751, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:15.364291 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ce73893c-b27c-444d-a0cb-dacac3c8354f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.369592 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] For port 23788fbf-07af-4ed8-b5ac-3203649e3751, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=23788fbf-07af-4ed8-b5ac-3203649e3751,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:15.382510 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.427333 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ce73893c-b27c-444d-a0cb-dacac3c8354f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.578528 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2e6c314-719f-42eb-bc14-333b1a66b3d2 None None] Pushing event updated for resources: {'Port': ['ID=23788fbf-07af-4ed8-b5ac-3203649e3751,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:15.734741 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ce73893c-b27c-444d-a0cb-dacac3c8354f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.737936 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ce73893c-b27c-444d-a0cb-dacac3c8354f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.739104 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-ce73893c-b27c-444d-a0cb-dacac3c8354f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/15af47e9-17dc-40f2-9082-e0f6d4f72f1f HTTP/1.1" status: 204 len: 168 time: 0.5375075 Nov 18 18:21:15.763532 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2d4e5099-7695-46f2-8a6d-5171c865f079 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/quotas/eed6400cd0414bc5a520c9886c2a4bde HTTP/1.1" status: 200 len: 375 time: 0.3934834 Nov 18 18:21:15.776904 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-e7d60673-88fd-4804-b967-7559e89a97dc None None] Provisioning complete for port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:15.777695 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e7d60673-88fd-4804-b967-7559e89a97dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:15.851349 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-e7d60673-88fd-4804-b967-7559e89a97dc None None] Port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:21:16.017466 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9c34ac66-32c3-4a5e-b103-bdb66bc347ec req-00f470b9-24cf-487d-8dbf-7a2c93f7b49f tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 210 time: 0.3096695 Nov 18 18:21:16.018074 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7a590f59-8ae8-4805-8b42-9517d4ef317a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:16.020770 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7a590f59-8ae8-4805-8b42-9517d4ef317a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:16.026752 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-7a590f59-8ae8-4805-8b42-9517d4ef317a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f4189ab1-b3f8-433f-aa70-34922487d8da HTTP/1.1" status: 204 len: 168 time: 1.0516737 Nov 18 18:21:16.039024 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-f33adb15-2d9d-45a7-9f42-3e7683cf07e7 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&fields=id HTTP/1.1" status: 200 len: 210 time: 0.2696528 Nov 18 18:21:16.041160 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce73893c-b27c-444d-a0cb-dacac3c8354f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=15af47e9-17dc-40f2-9082-e0f6d4f72f1f,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:16.053862 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Pushing event updated for resources: {'Port': ['ID=7d6934a0-5c28-4a10-a5e5-fd96332c82b4,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:16.065432 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a590f59-8ae8-4805-8b42-9517d4ef317a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4189ab1-b3f8-433f-aa70-34922487d8da,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:16.330099 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 23788fbf-07af-4ed8-b5ac-3203649e3751 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:16.398219 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Allocated IP 172.27.1.212 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/302efbee-d2dc-4e73-be12-9573a5e7a62f) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:16.444937 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 23788fbf-07af-4ed8-b5ac-3203649e3751 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:16.444937 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:16.455160 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:16.505839 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:16.562015 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:16.766456 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-795a5bfc-6f5d-4e19-b967-1aa924c4e071 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:21:16.767584 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-795a5bfc-6f5d-4e19-b967-1aa924c4e071 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2131286 Nov 18 18:21:16.875087 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:16.906898 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.024709 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-db8cdf1a-693c-4c01-9b84-71e9258d639f service neutron] 10.222.0.82 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2497206 Nov 18 18:21:17.025215 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35230) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:17.048468 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port 23788fbf-07af-4ed8-b5ac-3203649e3751, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=23788fbf-07af-4ed8-b5ac-3203649e3751,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:17.057368 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.058220 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:17.060195 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fae59e6f-370a-4c02-ab7f-ef01d5f429fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.142398 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2ec05688-d588-4846-8043-206ca36ec387 req-c67e6455-ad30-4833-9529-f578831fb18a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 210 time: 0.0372019 Nov 18 18:21:17.150471 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.228702 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Allocated IP 172.27.1.21 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/9796f4fb-9636-4217-a66f-0e1f422636dd) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:17.248881 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53fbc536-060d-4791-9b69-bddf08c37b99 None None] Network f2a08e65-1c6c-43fe-a019-78643e62bd9f requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:21:17.276969 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:17.311590 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:17.328706 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:17.345687 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.350237 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-d7ed4906-17ef-4f4d-ad31-865e26b64b02 None None] Provisioning complete for port 23788fbf-07af-4ed8-b5ac-3203649e3751 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:17.351356 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d7ed4906-17ef-4f4d-ad31-865e26b64b02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.455135 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.473749 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.476233 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1772530', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-499092'] for router_interface, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.487942 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=23788fbf-07af-4ed8-b5ac-3203649e3751,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:17.506871 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Pushing event updated for resources: {'Port': ['ID=302efbee-d2dc-4e73-be12-9573a5e7a62f,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:17.524118 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.531770 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:17.531999 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.627026 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:17.666125 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Pushing event updated for resources: {'Port': ['ID=9796f4fb-9636-4217-a66f-0e1f422636dd,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:17.677594 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:17.703569 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:17.728264 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.764372 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:17.780945 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:17.802472 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Pushing event updated for resources: {'Port': ['ID=7d6934a0-5c28-4a10-a5e5-fd96332c82b4,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:17.921678 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:18.039893 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fae59e6f-370a-4c02-ab7f-ef01d5f429fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:18.058536 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fae59e6f-370a-4c02-ab7f-ef01d5f429fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:18.093038 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-5cbe585a-d433-4f52-bb4f-414b00268da7 service neutron] 10.222.0.82 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.0185192 Nov 18 18:21:18.126943 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fae59e6f-370a-4c02-ab7f-ef01d5f429fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=01ef718e-9dd6-43de-95ea-2d61fcdfc6c2,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:18.130095 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Network d845755f-6a59-4935-8123-1a70c6e45968 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:18.143557 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:18.179768 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-fae59e6f-370a-4c02-ab7f-ef01d5f429fa admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c1e37c1fb3f94888b2b29fdc133b9bda&name=default HTTP/1.1" status: 200 len: 2992 time: 1.1525085 Nov 18 18:21:18.183200 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35272) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:18.250678 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-2d74686a-acd5-40ed-bc22-4dd9423690d0 None None] Provisioning complete for port 23788fbf-07af-4ed8-b5ac-3203649e3751 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:18.251061 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-2d74686a-acd5-40ed-bc22-4dd9423690d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:18.258710 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 23788fbf-07af-4ed8-b5ac-3203649e3751 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:18.376924 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:18.409359 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 23788fbf-07af-4ed8-b5ac-3203649e3751 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:18.409983 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:18.575484 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9c085947-54ea-4000-834a-52357ae14020 req-44addf9f-b6dd-406f-b5ca-b96c703496c7 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 210 time: 0.1422031 Nov 18 18:21:18.582171 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-15725c94-d54c-4876-bfb7-16c1607b24c3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:18.644466 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-15725c94-d54c-4876-bfb7-16c1607b24c3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:18.661180 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:18.667025 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:18.675258 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Router 5f928fdc-791e-4821-b088-039c140695e9 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102688) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:21:18.721743 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-078e0c0a-5305-40f6-bf99-cfa914a6bf4b None None] Provisioning complete for port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:18.722143 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-078e0c0a-5305-40f6-bf99-cfa914a6bf4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:18.781393 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-078e0c0a-5305-40f6-bf99-cfa914a6bf4b None None] Port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:21:18.789761 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:18.790400 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:18.814826 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8405be04-96cf-4895-9cea-a828950a660e req-2dc0ade9-931f-4b92-9db5-a3015bf8c822 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 210 time: 0.1978643 Nov 18 18:21:18.838503 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-15725c94-d54c-4876-bfb7-16c1607b24c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:18.848221 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-15725c94-d54c-4876-bfb7-16c1607b24c3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:18.849847 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-15725c94-d54c-4876-bfb7-16c1607b24c3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/01ef718e-9dd6-43de-95ea-2d61fcdfc6c2 HTTP/1.1" status: 204 len: 168 time: 0.6643407 Nov 18 18:21:18.877338 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15725c94-d54c-4876-bfb7-16c1607b24c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=01ef718e-9dd6-43de-95ea-2d61fcdfc6c2,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:18.965187 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:21:18.970941 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-533ba379-ad8e-431f-ba1c-c537265dad85 admin admin] 10.222.0.82 "PUT /v2.0/routers/5f928fdc-791e-4821-b088-039c140695e9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2594612 Nov 18 18:21:18.972255 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-430421', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-500439'] for router, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:19.025014 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Sync routers for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:21:19.057970 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:21:19.058621 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:19.130796 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-430421', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-500439'] for router, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:19.341440 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Router 89023a45-fdd3-4072-a54e-c2f1bb2139ce is scheduled to L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 with binding_index 1 {{(pid=102688) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 18:21:19.367464 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Router 9674107a-752c-42c3-a133-60c85d951af8 is scheduled to L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 with binding_index 1 {{(pid=102689) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 18:21:19.371713 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:21:19.501398 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:21:19.512589 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Sync routers for ids ['89023a45-fdd3-4072-a54e-c2f1bb2139ce'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:21:19.529969 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Routers {'89023a45-fdd3-4072-a54e-c2f1bb2139ce'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:21:19.530903 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['89023a45-fdd3-4072-a54e-c2f1bb2139ce'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:19.550451 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] Publish callbacks [] for router, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:19.552004 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-9a372749-5e21-4a80-a11f-8549f0bf7099 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 6.8198481 Nov 18 18:21:19.554769 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35334) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:19.824694 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 2, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:19.842849 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Set router 89023a45-fdd3-4072-a54e-c2f1bb2139ce gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:21:19.876311 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Checking router: 5f928fdc-791e-4821-b088-039c140695e9 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:21:19.876945 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Updating router 5f928fdc-791e-4821-b088-039c140695e9 port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 binding host dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:21:19.896312 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:21:19.912328 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:19.915402 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Sync routers for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:21:19.937650 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] Publish callbacks [] for router, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:19.940945 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-b7772a61-af2b-4dfd-83eb-c864f0a2d4a2 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 5.8653266 Nov 18 18:21:19.945261 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35354) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:19.966979 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:21:19.967608 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:20.079703 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bbb194ab-3d9a-4da1-88c6-e1e563d859aa req-c671fcad-86dc-495f-88db-1338724cd672 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 210 time: 0.0397947 Nov 18 18:21:20.338046 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4c5599a2-fe4d-4fa5-b01a-10b76a686367 req-2d104037-7562-4d28-a124-06d6b22998c0 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 210 time: 0.1209819 Nov 18 18:21:20.364268 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'name': 'tempest-ServerRescueNegativeTestJSON-1249927654-router', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212'}], 'enable_snat': True}, 'gw_port_id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:13Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 3, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'gw_port': {'id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5f:e7:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:15Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:20.421091 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Checking router: 89023a45-fdd3-4072-a54e-c2f1bb2139ce for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:21:20.421459 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Updating router 89023a45-fdd3-4072-a54e-c2f1bb2139ce port 302efbee-d2dc-4e73-be12-9573a5e7a62f binding host dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:21:20.459279 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:20.476989 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:20.656843 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Allocated IP 172.20.0.1 (3c8d9a8a-b5ab-438f-b6ad-3b4724905e38/96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4/f8c0b26a-5115-4ebd-840b-187eb8ac41ea) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:20.679189 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:21:20.682637 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35376) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:20.745819 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-b71c9982-a1d6-4000-a042-b9b6cd209438 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1763044160', 'description': 'tempest-description--1206129222'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:20.772713 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:20.809713 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b71c9982-a1d6-4000-a042-b9b6cd209438 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:20.820182 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:20.910283 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:20.929428 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:20.932830 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Publish callbacks [] for port, precommit_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:20.937795 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:20.938448 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-500260'] for router_interface, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:20.943356 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.020673 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9e9b2b3-9546-4af7-a5e8-619be8707d8e None None] Pushing event updated for resources: {'Port': ['ID=302efbee-d2dc-4e73-be12-9573a5e7a62f,revision_number=2']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:21.075245 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.095364 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Publish callbacks [] for port, precommit_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.101819 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Attempting to bind port 302efbee-d2dc-4e73-be12-9573a5e7a62f on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:21.102714 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Attempting to bind port 302efbee-d2dc-4e73-be12-9573a5e7a62f by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:21.103348 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Attempting to bind port 302efbee-d2dc-4e73-be12-9573a5e7a62f on network 2cab888d-52a8-434c-814e-4f25740decd0 {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:21.112351 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:21.113104 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Checking segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102691) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:21.114220 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.116381 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.117223 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Bound using segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:21.118625 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Bound port: 302efbee-d2dc-4e73-be12-9573a5e7a62f, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:21.119394 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.213574 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:18Z', 'revision_number': 3, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:21.248525 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.250434 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Pushing event updated for resources: {'Port': ['ID=f8c0b26a-5115-4ebd-840b-187eb8ac41ea,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:21.280427 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b71c9982-a1d6-4000-a042-b9b6cd209438 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.287323 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5cacb8-bd5a-4a0a-a300-968316b1452a None None] Pushing event updated for resources: {'Port': ['ID=7d6934a0-5c28-4a10-a5e5-fd96332c82b4,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:21.332680 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] For port 302efbee-d2dc-4e73-be12-9573a5e7a62f, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102691) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:21.334272 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b71c9982-a1d6-4000-a042-b9b6cd209438 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.339891 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] For port 302efbee-d2dc-4e73-be12-9573a5e7a62f, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=302efbee-d2dc-4e73-be12-9573a5e7a62f,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102691) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:21.343207 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4ca28f97-716f-4c31-be37-40a2b18724c8 req-ed80cbcb-9b5c-4d24-aebe-da71df930109 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 210 time: 0.1313939 Nov 18 18:21:21.344226 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Checking router: 9674107a-752c-42c3-a133-60c85d951af8 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:21:21.344665 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Updating router 9674107a-752c-42c3-a133-60c85d951af8 port 9796f4fb-9636-4217-a66f-0e1f422636dd binding host dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:21:21.391146 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.467461 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b71c9982-a1d6-4000-a042-b9b6cd209438 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.480786 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-b71c9982-a1d6-4000-a042-b9b6cd209438 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.7443783 Nov 18 18:21:21.481202 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35398) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:21.495993 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-dd759cbb-0aae-4516-a8dc-5847dbbae6c5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Request body: {'security_group_rule': {'security_group_id': 'e5005cc1-2b9d-448f-8794-6c9f2b619e80', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:21.504573 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Attempting to bind port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:21.504948 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Attempting to bind port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:21.505314 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Attempting to bind port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 on network d845755f-6a59-4935-8123-1a70c6e45968 {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:21.507887 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.544586 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Routers {'89023a45-fdd3-4072-a54e-c2f1bb2139ce'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:21:21.545177 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['89023a45-fdd3-4072-a54e-c2f1bb2139ce'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:21.567046 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.573161 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:21.573544 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Checking segment: {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:21.573955 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.574358 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Bound using segment: {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:21.574851 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Bound port: 7d6934a0-5c28-4a10-a5e5-fd96332c82b4, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:21.575233 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.596880 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9e9b2b3-9546-4af7-a5e8-619be8707d8e None None] Pushing event updated for resources: {'Port': ['ID=302efbee-d2dc-4e73-be12-9573a5e7a62f,revision_number=3']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:21.610004 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b71c9982-a1d6-4000-a042-b9b6cd209438 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e5005cc1-2b9d-448f-8794-6c9f2b619e80,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:21.613840 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.621644 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.623077 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1772530', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-499092'] for router_interface, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.687945 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f45f646a-5e32-4804-ac7d-6c13a45998f3 req-c4573ecd-8b06-4821-b61f-e75697dd53cb tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 210 time: 0.1481931 Nov 18 18:21:21.692950 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dd759cbb-0aae-4516-a8dc-5847dbbae6c5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.849740 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-d7fe794f-f9a3-4238-beb4-3dc66ef41280 None None] Provisioning complete for port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:21.849740 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d7fe794f-f9a3-4238-beb4-3dc66ef41280 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.865398 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.31', 57008) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:21.905508 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] Set router 89023a45-fdd3-4072-a54e-c2f1bb2139ce gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:21:21.960302 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Pushing event updated for resources: {'Port': ['ID=f8c0b26a-5115-4ebd-840b-187eb8ac41ea,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:21.977118 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dd759cbb-0aae-4516-a8dc-5847dbbae6c5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:21.997665 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dd759cbb-0aae-4516-a8dc-5847dbbae6c5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:22.045817 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:22.047418 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd759cbb-0aae-4516-a8dc-5847dbbae6c5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cfc6fedd-62d6-40f2-9bc4-333ff0e61ea1,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:22.048529 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:22.064301 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] For port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:22.078466 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-d7fe794f-f9a3-4238-beb4-3dc66ef41280 None None] Port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:21:22.111829 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dd759cbb-0aae-4516-a8dc-5847dbbae6c5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:22.113263 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-dd759cbb-0aae-4516-a8dc-5847dbbae6c5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6229012 Nov 18 18:21:22.118476 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35422) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:22.127973 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] For port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=7d6934a0-5c28-4a10-a5e5-fd96332c82b4,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:22.130593 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-4e1d1734-8f5a-438a-9349-3fe21b4bd6bc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Request body: {'security_group_rule': {'security_group_id': 'e5005cc1-2b9d-448f-8794-6c9f2b619e80', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:22.137962 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:22.184969 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Allocated IP 172.20.0.1 (f2a08e65-1c6c-43fe-a019-78643e62bd9f/53535ce7-7c2a-450f-87e4-d092908ff080/82ade1e6-a8c1-462a-97bb-16499ada8f89) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:22.200859 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-13e7f586-7f99-4fe9-9319-2de5f0ff641b tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:22.202627 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-13e7f586-7f99-4fe9-9319-2de5f0ff641b tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.31 "GET /v2.0/networks?id=7e134455-4777-4316-bbbd-bb2480fdc6bf HTTP/1.1" status: 200 len: 812 time: 0.3090260 Nov 18 18:21:22.235672 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4e1d1734-8f5a-438a-9349-3fe21b4bd6bc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:22.247025 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:21:22.248497 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:22.309324 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Request body: {'port': {'device_id': 'e9aad4c1-c9a9-4ede-b085-5d2c7455014e', 'network_id': '7e134455-4777-4316-bbbd-bb2480fdc6bf', 'admin_state_up': True, 'tenant_id': '83eb53a057ad4d528a3e2875be10dd97'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:22.475061 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Router 89023a45-fdd3-4072-a54e-c2f1bb2139ce has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102688) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:21:22.481180 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.31', 57011) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:22.512746 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:21:22.646338 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5cacb8-bd5a-4a0a-a300-968316b1452a None None] Pushing event updated for resources: {'Port': ['ID=7d6934a0-5c28-4a10-a5e5-fd96332c82b4,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:22.679414 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Publish callbacks [] for port, precommit_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:22.692133 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:22.696353 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'name': 'tempest-ServerRescueNegativeTestJSON-1249927654-router', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212'}], 'enable_snat': True}, 'gw_port_id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:13Z', 'updated_at': '2021-11-18T18:21:21Z', 'revision_number': 4, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'gw_port': {'id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5f:e7:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:15Z', 'updated_at': '2021-11-18T18:21:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'f8c0b26a-5115-4ebd-840b-187eb8ac41ea', 'name': '', 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'mac_address': 'fa:16:3e:c8:e2:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:20Z', 'updated_at': '2021-11-18T18:21:20Z', 'revision_number': 1, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'subnets': [{'id': '96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:22.734483 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9b6aac42-42ea-486f-b9d8-ca6cdfebb2d4 req-74313641-aa3c-4b38-8d70-852de3544a6c tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 210 time: 0.1153178 Nov 18 18:21:22.832735 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7df91c16-0a3d-45d1-89d6-5d0eddd56318 None None] The sync data for ids ['89023a45-fdd3-4072-a54e-c2f1bb2139ce'] in dv-cinder-787764-6-iscsi is: [{'id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'name': 'tempest-ServerRescueNegativeTestJSON-1249927654-router', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212'}], 'enable_snat': True}, 'gw_port_id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:13Z', 'updated_at': '2021-11-18T18:21:21Z', 'revision_number': 4, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'gw_port': {'id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5f:e7:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:15Z', 'updated_at': '2021-11-18T18:21:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'f8c0b26a-5115-4ebd-840b-187eb8ac41ea', 'name': '', 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'mac_address': 'fa:16:3e:c8:e2:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:20Z', 'updated_at': '2021-11-18T18:21:20Z', 'revision_number': 1, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'subnets': [{'id': '96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:21:22.860683 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Made reservation on behalf of 83eb53a057ad4d528a3e2875be10dd97 for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:22.864773 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:22.885982 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4e1d1734-8f5a-438a-9349-3fe21b4bd6bc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:22.903567 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:21:22.928107 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ad19953e-ee50-42ef-a6cb-6c34f17cd394 req-8bd6cd93-5e8c-452d-a833-fcdf55cccbd3 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 210 time: 0.0747707 Nov 18 18:21:22.939658 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:22.941183 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4e1d1734-8f5a-438a-9349-3fe21b4bd6bc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:23.046656 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e1d1734-8f5a-438a-9349-3fe21b4bd6bc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e6484e70-e577-495c-a09e-0afbef145d23,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:23.057202 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4e1d1734-8f5a-438a-9349-3fe21b4bd6bc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:23.072490 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-4e1d1734-8f5a-438a-9349-3fe21b4bd6bc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.9461851 Nov 18 18:21:23.073144 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35484) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:23.088202 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-5ec6fe75-2e2a-4388-afbc-13eb73f31289 None None] Provisioning complete for port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:23.089393 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5ec6fe75-2e2a-4388-afbc-13eb73f31289 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:23.091285 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Attempting to bind port 9796f4fb-9636-4217-a66f-0e1f422636dd on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:23.091792 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Attempting to bind port 9796f4fb-9636-4217-a66f-0e1f422636dd by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:23.092392 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Attempting to bind port 9796f4fb-9636-4217-a66f-0e1f422636dd on network 2cab888d-52a8-434c-814e-4f25740decd0 {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:23.126994 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07bab410-3b6b-43f5-b126-b3cee1f3c38c None None] Pushing event updated for resources: {'Port': ['ID=9796f4fb-9636-4217-a66f-0e1f422636dd,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:23.148330 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Request body: {'floatingip': {'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:23.154499 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:23.155231 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Checking segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:23.155866 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:23.156434 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Bound using segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:23.157135 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Bound port: 9796f4fb-9636-4217-a66f-0e1f422636dd, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:23.157828 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:23.273606 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:23.422629 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:23.688850 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-8845ed6a-28f3-4406-a2cf-05dd07f91403 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:23.693292 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-8845ed6a-28f3-4406-a2cf-05dd07f91403 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 815 time: 1.2053611 Nov 18 18:21:23.703419 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] For port 9796f4fb-9636-4217-a66f-0e1f422636dd, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:23.744601 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Request body: {'port': {'device_id': 'd97cfd7c-ce26-40fe-858c-abdf67b8024a', 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1', 'admin_state_up': True, 'tenant_id': 'eed6400cd0414bc5a520c9886c2a4bde'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:23.751888 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] For port 9796f4fb-9636-4217-a66f-0e1f422636dd, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=9796f4fb-9636-4217-a66f-0e1f422636dd,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:23.794279 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:23.825257 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:21:23.861147 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-5d62eefd-3ade-4e6b-b60e-da024ab31990 admin admin] 10.222.0.82 "PUT /v2.0/routers/89023a45-fdd3-4072-a54e-c2f1bb2139ce/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3048186 Nov 18 18:21:24.159081 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07bab410-3b6b-43f5-b126-b3cee1f3c38c None None] Pushing event updated for resources: {'Port': ['ID=9796f4fb-9636-4217-a66f-0e1f422636dd,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:24.174101 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:21:24.181086 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:24.187518 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5ec6fe75-2e2a-4388-afbc-13eb73f31289 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:24.358684 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Allocated IP 172.20.0.2 (7e134455-4777-4316-bbbd-bb2480fdc6bf/487bf315-c9f3-4691-b915-cf15db298f82/277548fe-9144-4153-ba17-e53c37a98205) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:24.476347 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-5ec6fe75-2e2a-4388-afbc-13eb73f31289 None None] For port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=7d6934a0-5c28-4a10-a5e5-fd96332c82b4,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:24.503371 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:22Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:24.549869 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Made reservation on behalf of eed6400cd0414bc5a520c9886c2a4bde for: {'port': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:24.555633 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:24.586665 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fd7e7dd8-a86d-423b-ad11-31a4c62c8b32 req-013c49df-1a1d-4ebd-b748-440e6a932d80 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 210 time: 0.5872111 Nov 18 18:21:24.637644 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Network f2a08e65-1c6c-43fe-a019-78643e62bd9f is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:24.799625 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bee20b81-dbe1-497a-b3e9-3d62b145e59d req-70c2a9d4-29e2-4d91-96f3-4c66c87d082c tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 210 time: 0.2432413 Nov 18 18:21:24.804491 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:24.854598 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:24.867554 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5ec6fe75-2e2a-4388-afbc-13eb73f31289 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:24.878474 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3b94879-6e28-4d89-aa12-f05892bfb424 None None] The sync data for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi is: [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:22Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:21:25.007459 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:25.032457 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:25.036158 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-500260'] for router_interface, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:25.145576 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:21:25.271787 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Pushing event updated for resources: {'Port': ['ID=82ade1e6-a8c1-462a-97bb-16499ada8f89,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:25.365036 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Allocated IP 172.20.0.2 (14ac84aa-8c04-4323-8592-aecfbb5a7fe1/488ef4e4-e6f9-414a-b93f-aabd7b232f9e/f3483de4-481b-47ac-8d51-f8457fd0bb85) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:25.603970 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Network 7e134455-4777-4316-bbbd-bb2480fdc6bf is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:25.747842 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:25.790941 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:25.848511 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:25.854700 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:25.858250 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ec6fe75-2e2a-4388-afbc-13eb73f31289 None None] Pushing event updated for resources: {'Port': ['ID=7d6934a0-5c28-4a10-a5e5-fd96332c82b4,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:25.877808 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:25.878688 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:25.938123 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.6511722 Nov 18 18:21:25.943006 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-f582ff3e-e6f0-4f1e-b209-fec94970e2e8 None None] Provisioning complete for port 82ade1e6-a8c1-462a-97bb-16499ada8f89 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:25.947076 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f582ff3e-e6f0-4f1e-b209-fec94970e2e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:25.981539 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-5f4d4d68-cba0-46a0-aa3b-fb5fea81610a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:25.989244 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-5f4d4d68-cba0-46a0-aa3b-fb5fea81610a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 819 time: 0.7505865 Nov 18 18:21:26.001370 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:26.009567 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:26.017507 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:26.023900 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:26.024420 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:26.043436 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-e7c3c88c-dd0a-463c-84a3-9e0b64c85ff3 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:21:26.044746 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-e7c3c88c-dd0a-463c-84a3-9e0b64c85ff3 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0366051 Nov 18 18:21:26.051184 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-f582ff3e-e6f0-4f1e-b209-fec94970e2e8 None None] Port 82ade1e6-a8c1-462a-97bb-16499ada8f89 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:21:26.073424 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Pushing event updated for resources: {'Port': ['ID=f3483de4-481b-47ac-8d51-f8457fd0bb85,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:26.094020 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d3f0102a-f6d7-450f-af39-33a13c797385 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3851271 Nov 18 18:21:26.114993 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-7bf30394-6dcf-44fc-a7b2-1f6541f01e86 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/quotas/76c33c7e96d748ee9e7cdd35c33082fa HTTP/1.1" status: 200 len: 375 time: 0.1246128 Nov 18 18:21:26.168686 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:26.194988 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:18Z', 'revision_number': 3, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:26.241495 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68a1c670-daa5-410f-8746-1644e6720c3e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Pushing event updated for resources: {'Port': ['ID=277548fe-9144-4153-ba17-e53c37a98205,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:26.324536 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-348ad1c1-36ba-41df-901d-c7288d6d5174 None None] The sync data for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi is: [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:18Z', 'revision_number': 3, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:21:26.373984 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 302efbee-d2dc-4e73-be12-9573a5e7a62f up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:26.428799 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 302efbee-d2dc-4e73-be12-9573a5e7a62f triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:26.429817 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:26.509705 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7827b1-ce67-44ec-b193-c5b1cc06c627 req-c6a6b90e-feaa-46e3-b115-f03e4f6ff8ca tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:26.532659 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9f7827b1-ce67-44ec-b193-c5b1cc06c627 req-c6a6b90e-feaa-46e3-b115-f03e4f6ff8ca tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 931 time: 0.7383485 Nov 18 18:21:26.598493 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Request body: {'port': {'device_id': 'e9aad4c1-c9a9-4ede-b085-5d2c7455014e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:26.609116 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:26.710134 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port 302efbee-d2dc-4e73-be12-9573a5e7a62f, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=302efbee-d2dc-4e73-be12-9573a5e7a62f,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:26.725115 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:26.726523 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:26.768516 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Request body: {'port': {'device_id': 'd97cfd7c-ce26-40fe-858c-abdf67b8024a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:26.785619 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:26.838824 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:27.074040 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=302efbee-d2dc-4e73-be12-9573a5e7a62f,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:27.111983 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:27.115213 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:27.133179 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Allocated IP 172.27.1.229 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/0eb6c469-7c0b-4b26-8e03-8a0645e44837) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:27.436295 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35654) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:27.436893 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35656) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:27.642942 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 277548fe-9144-4153-ba17-e53c37a98205 {{(pid=102688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:21:27.654451 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:27.733419 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.provisioning_blocks [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Transition to ACTIVE for port object 277548fe-9144-4153-ba17-e53c37a98205 will not be triggered until provisioned by entity L2. {{(pid=102688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:21:27.755686 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:27.791992 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-e9fecab8-723b-4092-ab61-16c800d0d9ab tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&fields=id HTTP/1.1" status: 200 len: 255 time: 1.6212056 Nov 18 18:21:27.816931 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-114203bc-ffa3-47a6-8677-fb902b69c1be admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:27.867294 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:27.876412 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9f7827b1-ce67-44ec-b193-c5b1cc06c627 req-3bb25fc3-7ea8-4969-bf2c-c75faf158d46 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.3426347 Nov 18 18:21:27.906872 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.123480 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Sync routers for ids ['89023a45-fdd3-4072-a54e-c2f1bb2139ce'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:21:28.141573 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Routers {'89023a45-fdd3-4072-a54e-c2f1bb2139ce'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:21:28.142203 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['89023a45-fdd3-4072-a54e-c2f1bb2139ce'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:28.163824 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Pushing event updated for resources: {'Port': ['ID=277548fe-9144-4153-ba17-e53c37a98205,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:28.196123 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Attempting to bind port 277548fe-9144-4153-ba17-e53c37a98205 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:28.196619 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Attempting to bind port 277548fe-9144-4153-ba17-e53c37a98205 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '75f5638d-c7c3-4b9a-9271-1a7bc4fecb74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1340, 'network_id': '7e134455-4777-4316-bbbd-bb2480fdc6bf'}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:28.196985 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Attempting to bind port 277548fe-9144-4153-ba17-e53c37a98205 on network 7e134455-4777-4316-bbbd-bb2480fdc6bf {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:28.205746 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Port 277548fe-9144-4153-ba17-e53c37a98205 on network 7e134455-4777-4316-bbbd-bb2480fdc6bf not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:21:28.206129 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Attempting to bind port 277548fe-9144-4153-ba17-e53c37a98205 on network 7e134455-4777-4316-bbbd-bb2480fdc6bf {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:28.213707 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:28.214147 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Checking segment: {'id': '75f5638d-c7c3-4b9a-9271-1a7bc4fecb74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1340, 'network_id': '7e134455-4777-4316-bbbd-bb2480fdc6bf'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:28.214770 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Bound using segment: {'id': '75f5638d-c7c3-4b9a-9271-1a7bc4fecb74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1340, 'network_id': '7e134455-4777-4316-bbbd-bb2480fdc6bf'} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:28.215248 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Bound port: 277548fe-9144-4153-ba17-e53c37a98205, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '75f5638d-c7c3-4b9a-9271-1a7bc4fecb74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1340, 'network_id': '7e134455-4777-4316-bbbd-bb2480fdc6bf'}}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:28.215701 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.254280 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dfc16a59-9dc1-41b7-af99-1ca14bd1a8f5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.419283 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 302efbee-d2dc-4e73-be12-9573a5e7a62f up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:28.445917 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.446756 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Set router 89023a45-fdd3-4072-a54e-c2f1bb2139ce gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:21:28.453034 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-0a6aa626-3a47-412b-a2b2-3f77b9024889 service neutron] 10.222.0.82 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6138592 Nov 18 18:21:28.461700 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.480884 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-114203bc-ffa3-47a6-8677-fb902b69c1be admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.484102 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] For port 277548fe-9144-4153-ba17-e53c37a98205, host hv-cinder-78776, cleared binding levels {{(pid=102688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:28.496515 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] For port 277548fe-9144-4153-ba17-e53c37a98205, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=277548fe-9144-4153-ba17-e53c37a98205,segment=NetworkSegment(75f5638d-c7c3-4b9a-9271-1a7bc4fecb74),segment_id=75f5638d-c7c3-4b9a-9271-1a7bc4fecb74)] {{(pid=102688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:28.498763 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-114203bc-ffa3-47a6-8677-fb902b69c1be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.525771 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.566844 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 302efbee-d2dc-4e73-be12-9573a5e7a62f triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:28.569467 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.576834 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.580905 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1772530', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-499092'] for router_interface, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.662293 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-114203bc-ffa3-47a6-8677-fb902b69c1be admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=843b68e56c63474ab2b8790d56a430a1&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2248826 Nov 18 18:21:28.664569 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-114203bc-ffa3-47a6-8677-fb902b69c1be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ea36d7b-ecde-49f3-89a7-cd6ba357e460,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:28.703238 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:28.704057 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.713602 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] 10.222.0.31 "PUT /v2.0/ports/277548fe-9144-4153-ba17-e53c37a98205 HTTP/1.1" status: 200 len: 1093 time: 2.2886434 Nov 18 18:21:28.724672 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35672) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:28.753433 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e9aad4c1-c9a9-4ede-b085-5d2c7455014e', 'tag': '277548fe-9144-4153-ba17-e53c37a98205'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:21:28.815036 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 9796f4fb-9636-4217-a66f-0e1f422636dd up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:28.855539 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'name': 'tempest-ServerRescueNegativeTestJSON-1249927654-router', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212'}], 'enable_snat': True}, 'gw_port_id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:13Z', 'updated_at': '2021-11-18T18:21:21Z', 'revision_number': 4, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'gw_port': {'id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5f:e7:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:15Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'f8c0b26a-5115-4ebd-840b-187eb8ac41ea', 'name': '', 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'mac_address': 'fa:16:3e:c8:e2:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:20Z', 'updated_at': '2021-11-18T18:21:21Z', 'revision_number': 2, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'subnets': [{'id': '96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:28.899980 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Checking router: 89023a45-fdd3-4072-a54e-c2f1bb2139ce for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:21:28.902034 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Updating router 89023a45-fdd3-4072-a54e-c2f1bb2139ce port f8c0b26a-5115-4ebd-840b-187eb8ac41ea binding host dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:21:28.940895 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:28.945316 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 9796f4fb-9636-4217-a66f-0e1f422636dd triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:28.945823 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:29.141732 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:29.193933 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port 9796f4fb-9636-4217-a66f-0e1f422636dd, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=9796f4fb-9636-4217-a66f-0e1f422636dd,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:29.201818 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:29.265343 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event updated for resources: {'Port': ['ID=0eb6c469-7c0b-4b26-8e03-8a0645e44837,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:29.394588 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=9796f4fb-9636-4217-a66f-0e1f422636dd,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:29.424681 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-384e1b4d-dab8-462d-9408-431f430c4e08 service neutron] Pushing event updated for resources: {'Port': ['ID=277548fe-9144-4153-ba17-e53c37a98205,revision_number=3']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:29.534857 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-7fa584e6-2e1f-43ff-8607-63d3b3c875d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:29.536769 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-7fa584e6-2e1f-43ff-8607-63d3b3c875d0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=83eb53a057ad4d528a3e2875be10dd97&device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 1096 time: 0.2756410 Nov 18 18:21:29.548628 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Publish callbacks [] for port, precommit_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:29.558751 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:29.566412 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-733589eb-cc04-4b24-a71c-9b29bb03b31e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:29.571465 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-302b95d1-cb35-46db-984a-c54889e34ee2" -d '{"events": [{"name": "network-changed", "server_uuid": "e9aad4c1-c9a9-4ede-b085-5d2c7455014e", "tag": "277548fe-9144-4153-ba17-e53c37a98205"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:21:29.634311 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Pushing event updated for resources: {'Port': ['ID=82ade1e6-a8c1-462a-97bb-16499ada8f89,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:29.661615 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-467280d0-e2e6-4f4e-9aed-32ac3ed82d28 None None] Pushing event updated for resources: {'Port': ['ID=f8c0b26a-5115-4ebd-840b-187eb8ac41ea,revision_number=3']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:29.728453 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-814c2536-47ae-4800-a1eb-8f309a4c8df3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=277548fe-9144-4153-ba17-e53c37a98205 HTTP/1.1" status: 200 len: 217 time: 0.1514635 Nov 18 18:21:29.743196 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-733589eb-cc04-4b24-a71c-9b29bb03b31e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:29.749256 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978410b0-d081-46b7-a69c-afe2fd352122 req-5a829e88-9cf1-4aae-9708-0328405b4cb0 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:29.750908 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-978410b0-d081-46b7-a69c-afe2fd352122 req-5a829e88-9cf1-4aae-9708-0328405b4cb0 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 931 time: 1.4882715 Nov 18 18:21:29.809534 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-e8da4c78-23c5-4ed2-b4b7-241a1c0e8ff3 service neutron] 10.222.0.82 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.2388415 Nov 18 18:21:29.861846 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:29.890138 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:29.901020 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:29.915535 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Attempting to bind port f8c0b26a-5115-4ebd-840b-187eb8ac41ea on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:29.915947 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Attempting to bind port f8c0b26a-5115-4ebd-840b-187eb8ac41ea by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:29.916501 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Attempting to bind port f8c0b26a-5115-4ebd-840b-187eb8ac41ea on network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:29.940276 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:29.940710 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Checking segment: {'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102691) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:29.944875 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:29.945324 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Bound using segment: {'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:29.949738 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Bound port: f8c0b26a-5115-4ebd-840b-187eb8ac41ea, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'}}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:29.952222 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:30.047644 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] For port f8c0b26a-5115-4ebd-840b-187eb8ac41ea, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102691) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:30.048856 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-b1c13038-426a-4b34-807d-8d86b2d2c182 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:30.052262 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] For port f8c0b26a-5115-4ebd-840b-187eb8ac41ea, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=f8c0b26a-5115-4ebd-840b-187eb8ac41ea,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102691) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:30.056199 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-b1c13038-426a-4b34-807d-8d86b2d2c182 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=487bf315-c9f3-4691-b915-cf15db298f82 HTTP/1.1" status: 200 len: 852 time: 0.2767859 Nov 18 18:21:30.059413 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:30.066772 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:30.083016 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-733589eb-cc04-4b24-a71c-9b29bb03b31e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:30.087562 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-733589eb-cc04-4b24-a71c-9b29bb03b31e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:30.092089 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-733589eb-cc04-4b24-a71c-9b29bb03b31e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6ea36d7b-ecde-49f3-89a7-cd6ba357e460 HTTP/1.1" status: 204 len: 168 time: 1.1729476 Nov 18 18:21:30.106040 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-733589eb-cc04-4b24-a71c-9b29bb03b31e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ea36d7b-ecde-49f3-89a7-cd6ba357e460,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:30.168806 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-467280d0-e2e6-4f4e-9aed-32ac3ed82d28 None None] Pushing event updated for resources: {'Port': ['ID=f8c0b26a-5115-4ebd-840b-187eb8ac41ea,revision_number=4']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:30.236666 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-978410b0-d081-46b7-a69c-afe2fd352122 req-6d477164-a583-4800-9c05-c554074ecd2e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4260464 Nov 18 18:21:30.242471 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-636cfe8c-cb81-4385-8bb3-2f5f57d8fff6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7e134455-4777-4316-bbbd-bb2480fdc6bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1173151 Nov 18 18:21:30.252527 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 9796f4fb-9636-4217-a66f-0e1f422636dd up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:30.273393 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Routers {'89023a45-fdd3-4072-a54e-c2f1bb2139ce'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:21:30.278102 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['89023a45-fdd3-4072-a54e-c2f1bb2139ce'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:30.380267 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 9796f4fb-9636-4217-a66f-0e1f422636dd triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:30.383592 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:30.481572 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e68de18f-5139-48ae-9f6b-a8cee7bc72dd req-c18856cc-a32d-441e-8a49-d74cd77b99be tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:30.483156 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e68de18f-5139-48ae-9f6b-a8cee7bc72dd req-c18856cc-a32d-441e-8a49-d74cd77b99be tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 943 time: 0.2049723 Nov 18 18:21:30.483761 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:30.492581 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-c6c05fee-157f-4889-9e54-542ef7fb82d7 service neutron] 10.222.0.31 "GET /v2.0/networks/7e134455-4777-4316-bbbd-bb2480fdc6bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2348650 Nov 18 18:21:30.674675 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d39beb5d-cd49-4103-b172-cd581ed6283c req-4ad17688-9df2-4759-91be-762821ea4d1e service neutron] 10.222.0.31 "GET /v2.0/networks/7e134455-4777-4316-bbbd-bb2480fdc6bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1681216 Nov 18 18:21:30.689889 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:21:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9940b47c-86ca-4c55-9037-0a10654f6e6f x-openstack-request-id: req-9940b47c-86ca-4c55-9037-0a10654f6e6f {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:21:30.690433 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e9aad4c1-c9a9-4ede-b085-5d2c7455014e", "tag": "277548fe-9144-4153-ba17-e53c37a98205", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:21:30.690782 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-9940b47c-86ca-4c55-9037-0a10654f6e6f {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:21:30.691374 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e9aad4c1-c9a9-4ede-b085-5d2c7455014e', 'tag': '277548fe-9144-4153-ba17-e53c37a98205', 'status': 'completed', 'code': 200} Nov 18 18:21:30.747680 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dfc16a59-9dc1-41b7-af99-1ca14bd1a8f5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:30.828734 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] Set router 89023a45-fdd3-4072-a54e-c2f1bb2139ce gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:21:30.833962 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dfc16a59-9dc1-41b7-af99-1ca14bd1a8f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:30.867789 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Network f2a08e65-1c6c-43fe-a019-78643e62bd9f is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:30.938884 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35726) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:30.956537 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-421755dc-5e2e-46f3-8b9b-e6f08954ef14 req-e414cd18-a4bb-4cbd-b12d-9f5c70c7a885 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 210 time: 0.2004876 Nov 18 18:21:30.969882 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-eb3530e0-4f3a-4784-86d2-ad2b9f940491 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:31.056735 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-dfc16a59-9dc1-41b7-af99-1ca14bd1a8f5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7c2395abb9fb4b0e93702aa7e759f9b4&name=default HTTP/1.1" status: 200 len: 2996 time: 3.5581558 Nov 18 18:21:31.062662 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35732) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:31.099806 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e68de18f-5139-48ae-9f6b-a8cee7bc72dd req-42dfcef3-59c5-4090-9f4d-c3cd8b360d07 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4478376 Nov 18 18:21:31.105752 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:31.243849 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f3483de4-481b-47ac-8d51-f8457fd0bb85 {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:21:31.256028 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:31.288379 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'name': 'tempest-ServerRescueNegativeTestJSON-1249927654-router', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212'}], 'enable_snat': True}, 'gw_port_id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:13Z', 'updated_at': '2021-11-18T18:21:21Z', 'revision_number': 4, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'gw_port': {'id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5f:e7:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:15Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'f8c0b26a-5115-4ebd-840b-187eb8ac41ea', 'name': '', 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'mac_address': 'fa:16:3e:c8:e2:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:20Z', 'updated_at': '2021-11-18T18:21:30Z', 'revision_number': 4, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'subnets': [{'id': '96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:31.345408 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a645a1d-e070-402d-83e0-7aa3ff7e3196 None None] The sync data for ids ['89023a45-fdd3-4072-a54e-c2f1bb2139ce'] in dv-cinder-787764-6-iscsi is: [{'id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'name': 'tempest-ServerRescueNegativeTestJSON-1249927654-router', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212'}], 'enable_snat': True}, 'gw_port_id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:13Z', 'updated_at': '2021-11-18T18:21:21Z', 'revision_number': 4, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'gw_port': {'id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5f:e7:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:15Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'f8c0b26a-5115-4ebd-840b-187eb8ac41ea', 'name': '', 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'mac_address': 'fa:16:3e:c8:e2:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:20Z', 'updated_at': '2021-11-18T18:21:30Z', 'revision_number': 4, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'subnets': [{'id': '96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:21:31.384622 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Transition to ACTIVE for port object f3483de4-481b-47ac-8d51-f8457fd0bb85 will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:21:31.484705 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:31.487267 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc16a59-9dc1-41b7-af99-1ca14bd1a8f5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d126987d-e5dc-479f-8114-652a1a71d823,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:31.494996 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-302b95d1-cb35-46db-984a-c54889e34ee2 req-e018fb57-0848-4a7d-b91f-f3807fca1970 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:31.514269 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-302b95d1-cb35-46db-984a-c54889e34ee2 req-e018fb57-0848-4a7d-b91f-f3807fca1970 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=83eb53a057ad4d528a3e2875be10dd97&device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 1096 time: 0.3696396 Nov 18 18:21:31.516941 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c9b859b4-df62-4cf9-91a8-30d1ead5f115 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:31.538107 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:31.541295 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:31.648321 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-928a9155-8e16-4c7c-9672-9ed5a506a02f None None] Provisioning complete for port 82ade1e6-a8c1-462a-97bb-16499ada8f89 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:31.649283 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-928a9155-8e16-4c7c-9672-9ed5a506a02f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:31.694926 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-eb3530e0-4f3a-4784-86d2-ad2b9f940491 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:31.729458 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c9b859b4-df62-4cf9-91a8-30d1ead5f115 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:31.735657 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-eb3530e0-4f3a-4784-86d2-ad2b9f940491 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:31.772979 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-928a9155-8e16-4c7c-9672-9ed5a506a02f None None] Port 82ade1e6-a8c1-462a-97bb-16499ada8f89 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:21:31.847054 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-54fce0c2-f054-46de-b0ed-c96addd4d6ae tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:31.855789 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-54fce0c2-f054-46de-b0ed-c96addd4d6ae tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 819 time: 0.3311636 Nov 18 18:21:32.161287 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb3530e0-4f3a-4784-86d2-ad2b9f940491 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4998f311-e581-474d-bc64-3fff5c2031a6,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:32.166742 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event updated for resources: {'Port': ['ID=0eb6c469-7c0b-4b26-8e03-8a0645e44837,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:32.172024 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-eb3530e0-4f3a-4784-86d2-ad2b9f940491 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5d494dc6c9b848bca0f014f21be3b10a&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2318323 Nov 18 18:21:32.208227 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35758) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:32.294850 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device f8c0b26a-5115-4ebd-840b-187eb8ac41ea up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:32.311890 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-302b95d1-cb35-46db-984a-c54889e34ee2 req-7bd990b4-6ec0-4fed-b0ce-6876967962b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:32.313960 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-302b95d1-cb35-46db-984a-c54889e34ee2 req-7bd990b4-6ec0-4fed-b0ce-6876967962b1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=7e134455-4777-4316-bbbd-bb2480fdc6bf HTTP/1.1" status: 200 len: 914 time: 0.7517431 Nov 18 18:21:32.340787 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c0f3b3c4-5c4f-41e7-99eb-6c1d1545b53a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:32.362325 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:32.369626 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c9b859b4-df62-4cf9-91a8-30d1ead5f115 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:32.373465 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c9b859b4-df62-4cf9-91a8-30d1ead5f115 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:32.374899 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-c9b859b4-df62-4cf9-91a8-30d1ead5f115 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d126987d-e5dc-479f-8114-652a1a71d823 HTTP/1.1" status: 204 len: 168 time: 1.3110275 Nov 18 18:21:32.393137 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-0e339e4b-5f37-4529-ad90-6c78efaadb3e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/quotas/76c33c7e96d748ee9e7cdd35c33082fa HTTP/1.1" status: 200 len: 375 time: 0.5363698 Nov 18 18:21:32.398242 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Router 9674107a-752c-42c3-a133-60c85d951af8 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:21:32.417805 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port f8c0b26a-5115-4ebd-840b-187eb8ac41ea triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:32.418562 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:32.460347 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c0f3b3c4-5c4f-41e7-99eb-6c1d1545b53a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:32.467211 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9b859b4-df62-4cf9-91a8-30d1ead5f115 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d126987d-e5dc-479f-8114-652a1a71d823,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:32.483429 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Pushing event updated for resources: {'Port': ['ID=f3483de4-481b-47ac-8d51-f8457fd0bb85,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:32.581131 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e793bd-a5fc-4da8-a1bb-abb78c5ab104 req-50061789-3f10-4015-9162-942b7e4d19f0 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:32.583629 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-52e793bd-a5fc-4da8-a1bb-abb78c5ab104 req-50061789-3f10-4015-9162-942b7e4d19f0 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 943 time: 1.0554066 Nov 18 18:21:32.612916 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:32.620083 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c0f3b3c4-5c4f-41e7-99eb-6c1d1545b53a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:32.627274 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c0f3b3c4-5c4f-41e7-99eb-6c1d1545b53a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:32.627274 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-c0f3b3c4-5c4f-41e7-99eb-6c1d1545b53a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4998f311-e581-474d-bc64-3fff5c2031a6 HTTP/1.1" status: 204 len: 168 time: 0.4147978 Nov 18 18:21:32.629079 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:32.638840 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-bc954e6b-9d62-4fc6-8ea4-eb5c70e2213f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 9.5205381 Nov 18 18:21:32.639002 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0f3b3c4-5c4f-41e7-99eb-6c1d1545b53a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4998f311-e581-474d-bc64-3fff5c2031a6,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:32.732319 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port f8c0b26a-5115-4ebd-840b-187eb8ac41ea, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=f8c0b26a-5115-4ebd-840b-187eb8ac41ea,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:32.740924 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:32.759177 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Attempting to bind port f3483de4-481b-47ac-8d51-f8457fd0bb85 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:32.759668 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Attempting to bind port f3483de4-481b-47ac-8d51-f8457fd0bb85 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:32.759877 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Attempting to bind port f3483de4-481b-47ac-8d51-f8457fd0bb85 on network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:32.812325 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Port f3483de4-481b-47ac-8d51-f8457fd0bb85 on network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:21:32.812646 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Attempting to bind port f3483de4-481b-47ac-8d51-f8457fd0bb85 on network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:32.822578 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-570fa366-860d-4f5f-b691-2b7ade01f9e9 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&fields=id HTTP/1.1" status: 200 len: 255 time: 0.3672795 Nov 18 18:21:32.838226 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:32.838568 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Checking segment: {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:32.839120 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Bound using segment: {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:32.839583 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Bound port: f3483de4-481b-47ac-8d51-f8457fd0bb85, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:32.840016 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:32.878016 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-52e793bd-a5fc-4da8-a1bb-abb78c5ab104 req-81595f17-02a6-4425-8efa-a3356dd0ed62 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2328155 Nov 18 18:21:32.924467 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=f8c0b26a-5115-4ebd-840b-187eb8ac41ea,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:33.073134 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35772) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:33.099675 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b9ead26f-85ee-472d-bb9a-603522e2e733 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:33.195600 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-b6439aae-edbb-4e25-8b6f-0c3f184faa05 service neutron] 10.222.0.82 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3601854 Nov 18 18:21:33.229302 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] For port f3483de4-481b-47ac-8d51-f8457fd0bb85, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:33.234373 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] For port f3483de4-481b-47ac-8d51-f8457fd0bb85, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f3483de4-481b-47ac-8d51-f8457fd0bb85,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:33.253087 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b9ead26f-85ee-472d-bb9a-603522e2e733 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:33.259732 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b9ead26f-85ee-472d-bb9a-603522e2e733 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:33.325810 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-b9ead26f-85ee-472d-bb9a-603522e2e733 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=37a237fe628c4dc4b11bb52c9fa3594f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2515826 Nov 18 18:21:33.326856 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9ead26f-85ee-472d-bb9a-603522e2e733 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cca8b9d2-baac-43e1-a2c1-b1e1d415aa83,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:33.329424 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35782) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:33.372446 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-4c3db058-c4db-472c-8845-26fc609c4b07 service neutron] 10.222.0.82 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1345890 Nov 18 18:21:33.380260 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:33.454261 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-901ddf62-5c81-441a-89d8-3c2f2ead3336 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:33.466119 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Pushing event updated for resources: {'Port': ['ID=f3483de4-481b-47ac-8d51-f8457fd0bb85,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:33.510605 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-901ddf62-5c81-441a-89d8-3c2f2ead3336 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:33.515250 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:33.519904 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:33.521930 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2190ee00-df42-48b2-9d20-877d62dc0eda service neutron] 10.222.0.31 "PUT /v2.0/ports/f3483de4-481b-47ac-8d51-f8457fd0bb85 HTTP/1.1" status: 200 len: 1093 time: 6.9840138 Nov 18 18:21:33.547198 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45082f54-0ee5-4e77-b77a-f88830d1e4a5 req-6362db45-2edb-492d-a58c-7e262d5a6fb9 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:33.562814 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-45082f54-0ee5-4e77-b77a-f88830d1e4a5 req-6362db45-2edb-492d-a58c-7e262d5a6fb9 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 943 time: 0.3267677 Nov 18 18:21:33.568660 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd97cfd7c-ce26-40fe-858c-abdf67b8024a', 'tag': 'f3483de4-481b-47ac-8d51-f8457fd0bb85'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:21:33.643376 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-901ddf62-5c81-441a-89d8-3c2f2ead3336 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:33.646305 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-901ddf62-5c81-441a-89d8-3c2f2ead3336 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:33.648122 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-901ddf62-5c81-441a-89d8-3c2f2ead3336 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cca8b9d2-baac-43e1-a2c1-b1e1d415aa83 HTTP/1.1" status: 204 len: 168 time: 0.3044205 Nov 18 18:21:33.722279 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-302b95d1-cb35-46db-984a-c54889e34ee2 req-41458ae4-a2bc-4398-961f-eb9f7724c24f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=277548fe-9144-4153-ba17-e53c37a98205 HTTP/1.1" status: 200 len: 217 time: 0.1003566 Nov 18 18:21:33.728595 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:21:33.743165 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Sync routers for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:21:33.777652 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-901ddf62-5c81-441a-89d8-3c2f2ead3336 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cca8b9d2-baac-43e1-a2c1-b1e1d415aa83,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:33.778740 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:21:33.780108 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:33.807567 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-5098c320-3536-428b-a547-ba7155b2f6a0 admin admin] 10.222.0.82 "PUT /v2.0/routers/9674107a-752c-42c3-a133-60c85d951af8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 13.8598475 Nov 18 18:21:33.911852 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-302b95d1-cb35-46db-984a-c54889e34ee2 req-a8c713e2-9147-4cfa-83c3-280d1975e561 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:33.913311 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-302b95d1-cb35-46db-984a-c54889e34ee2 req-a8c713e2-9147-4cfa-83c3-280d1975e561 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=487bf315-c9f3-4691-b915-cf15db298f82 HTTP/1.1" status: 200 len: 852 time: 0.1660855 Nov 18 18:21:34.078335 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-302b95d1-cb35-46db-984a-c54889e34ee2 req-d6ccb566-20e7-4079-ac1c-08cc7318037a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7e134455-4777-4316-bbbd-bb2480fdc6bf&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1354055 Nov 18 18:21:34.161278 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-aada050d-0359-4cdb-a55d-7900e765e956 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:34.190464 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.31', 57027) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:34.194942 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-45082f54-0ee5-4e77-b77a-f88830d1e4a5 req-da9c4df0-9cfa-4774-8895-cc3e7376aa85 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6304760 Nov 18 18:21:34.275490 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-06cac013-64b3-45e7-829b-b10ff9c19f66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:34.283473 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-06cac013-64b3-45e7-829b-b10ff9c19f66 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 1096 time: 0.5430787 Nov 18 18:21:34.306174 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-e4d10540-6103-4cb6-becc-1cf3e1ab0e39 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1763044160&fields=id&tenant_id=6a79674a70ee4ad7acedc7d4896b413e HTTP/1.1" status: 200 len: 267 time: 0.3389072 Nov 18 18:21:34.308451 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device f8c0b26a-5115-4ebd-840b-187eb8ac41ea up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:34.322568 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:21:34.606904 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-302b95d1-cb35-46db-984a-c54889e34ee2 req-5c47bdc4-0091-4ebe-9067-83370b351150 service neutron] 10.222.0.31 "GET /v2.0/networks/7e134455-4777-4316-bbbd-bb2480fdc6bf?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5164673 Nov 18 18:21:34.696862 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ee67a0f5-6de7-4d39-ace3-286b946b6da2 req-7a55df06-aedf-460e-9148-dfa1acbe3244 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 210 time: 0.1621828 Nov 18 18:21:34.698127 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-bb8538be-bac0-4461-8057-60790116dfec service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=f3483de4-481b-47ac-8d51-f8457fd0bb85 HTTP/1.1" status: 200 len: 217 time: 0.3863196 Nov 18 18:21:34.715015 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b8ad512-02b7-4e2c-9050-5bdba53a393c" -d '{"events": [{"name": "network-changed", "server_uuid": "d97cfd7c-ce26-40fe-858c-abdf67b8024a", "tag": "f3483de4-481b-47ac-8d51-f8457fd0bb85"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:21:34.717660 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-b959ed69-936f-4f79-b901-3079ea7be14e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:34.719269 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-b959ed69-936f-4f79-b901-3079ea7be14e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.31 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 819 time: 0.5234725 Nov 18 18:21:34.794592 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Request body: {'port': {'device_id': 'cd7419e5-272b-4c8a-a4a2-9b75dc0b9400', 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38', 'admin_state_up': True, 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:35.065155 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-302b95d1-cb35-46db-984a-c54889e34ee2 req-fcc8e1e3-c2dd-45a5-89dd-6eb07cac6e9c service neutron] 10.222.0.31 "GET /v2.0/networks/7e134455-4777-4316-bbbd-bb2480fdc6bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4428246 Nov 18 18:21:35.094261 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2fa9a97c-5473-4936-aa52-8fc9c816f325 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:35.095847 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-2fa9a97c-5473-4936-aa52-8fc9c816f325 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=488ef4e4-e6f9-414a-b93f-aabd7b232f9e HTTP/1.1" status: 200 len: 855 time: 0.3747823 Nov 18 18:21:35.152681 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Made reservation on behalf of 76c33c7e96d748ee9e7cdd35c33082fa for: {'port': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:35.179649 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:35.182930 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701c559e-c6a9-480d-8f74-0d25af402756 req-686dfa46-d9f1-48b7-af03-4440698a2e96 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:35.195023 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-686dfa46-d9f1-48b7-af03-4440698a2e96 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 817 time: 0.7776277 Nov 18 18:21:35.217173 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f993228-6bd0-4818-9f61-a968514dc366 req-c903692d-a883-4808-a738-cd4354e4820c tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:35.217173 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0f993228-6bd0-4818-9f61-a968514dc366 req-c903692d-a883-4808-a738-cd4354e4820c tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 943 time: 0.2528570 Nov 18 18:21:35.226575 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port f8c0b26a-5115-4ebd-840b-187eb8ac41ea triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:35.227122 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:35.279252 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-315d2614-f2e1-44d2-bb54-fbc9959c5347 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/quotas/6a79674a70ee4ad7acedc7d4896b413e HTTP/1.1" status: 200 len: 375 time: 0.0833452 Nov 18 18:21:35.468817 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0f993228-6bd0-4818-9f61-a968514dc366 req-2096557f-2c9a-476a-bb88-1f4e643f084e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2392545 Nov 18 18:21:35.549643 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-a5a2f2e5-b9a6-45c7-b5c5-98ba661f7b24 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2681572 Nov 18 18:21:35.597934 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Allocated IP 172.20.0.6 (3c8d9a8a-b5ab-438f-b6ad-3b4724905e38/96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4/b627bee7-04b0-4a31-8ff0-84f976c65917) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:35.609272 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:27Z', 'revision_number': 2, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:35.672017 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Checking router: 9674107a-752c-42c3-a133-60c85d951af8 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:21:35.672446 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Updating router 9674107a-752c-42c3-a133-60c85d951af8 port 82ade1e6-a8c1-462a-97bb-16499ada8f89 binding host dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:21:35.737207 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:35.846111 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-3276edb7-55ca-4d9f-9a49-f3ce550f1902 service neutron] 10.222.0.82 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2767975 Nov 18 18:21:35.918098 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:36.007903 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:36.127831 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:36.137299 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:36.146843 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-16ae0b2e-aa68-445b-b346-52b4dc5590a2 service neutron] 10.222.0.82 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2903097 Nov 18 18:21:36.169181 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:36.182432 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:36.183108 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:36.191425 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Pushing event updated for resources: {'Port': ['ID=b627bee7-04b0-4a31-8ff0-84f976c65917,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:36.230110 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-f5a2ae2c-b33d-4b2b-aaab-e74a30e96ecf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4643030 Nov 18 18:21:36.374629 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35890) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:36.386177 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-bfe3923e-e6bc-4eb1-8100-535ac9dbc9bd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1044095394', 'description': 'tempest-description--1030665233'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:36.427630 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfe3923e-e6bc-4eb1-8100-535ac9dbc9bd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:36.471266 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Publish callbacks [] for port, precommit_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:36.493601 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:36.517851 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a2346ecd-f1f3-46a4-a8a6-55611d2d2393 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:36.538388 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfe3923e-e6bc-4eb1-8100-535ac9dbc9bd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:36.541540 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfe3923e-e6bc-4eb1-8100-535ac9dbc9bd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:36.622842 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfe3923e-e6bc-4eb1-8100-535ac9dbc9bd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:36.624282 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-bfe3923e-e6bc-4eb1-8100-535ac9dbc9bd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.2477996 Nov 18 18:21:36.628390 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 35906) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:36.630467 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfe3923e-e6bc-4eb1-8100-535ac9dbc9bd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fa2c021a-c84e-4618-bb5b-faf8330f97f4,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:36.637829 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-d2ce25c0-fbf0-4dbe-9b0a-a096f85a2033 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Request body: {'security_group_rule': {'security_group_id': 'fa2c021a-c84e-4618-bb5b-faf8330f97f4', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:36.664609 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36e8e349-8b8b-4638-b5a1-220a11e39b47 req-ef7e71ea-163e-4c6d-a7a6-7032c456c2bb tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:36.666238 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-36e8e349-8b8b-4638-b5a1-220a11e39b47 req-ef7e71ea-163e-4c6d-a7a6-7032c456c2bb tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 943 time: 0.1305177 Nov 18 18:21:36.701143 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a966be5c-3851-4599-81f7-57253ade65c3 None None] Pushing event updated for resources: {'Port': ['ID=82ade1e6-a8c1-462a-97bb-16499ada8f89,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:36.726043 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Request body: {'port': {'device_id': 'cd7419e5-272b-4c8a-a4a2-9b75dc0b9400', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:36.856376 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Attempting to bind port 82ade1e6-a8c1-462a-97bb-16499ada8f89 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:36.860139 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d2ce25c0-fbf0-4dbe-9b0a-a096f85a2033 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:36.862975 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Attempting to bind port 82ade1e6-a8c1-462a-97bb-16499ada8f89 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:36.863638 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Attempting to bind port 82ade1e6-a8c1-462a-97bb-16499ada8f89 on network f2a08e65-1c6c-43fe-a019-78643e62bd9f {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:36.871859 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-634b9c4d-8ec4-4493-89b1-2404807ab084 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1554472 Nov 18 18:21:36.886111 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:36.886506 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Checking segment: {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:36.886898 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:36.887286 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Bound using segment: {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:36.909448 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Bound port: 82ade1e6-a8c1-462a-97bb-16499ada8f89, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:36.909872 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:37.022999 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:37.085615 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:21:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3d4b354-45a6-4080-96ed-5f27bf86c8cf x-openstack-request-id: req-d3d4b354-45a6-4080-96ed-5f27bf86c8cf {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:21:37.085919 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d97cfd7c-ce26-40fe-858c-abdf67b8024a", "tag": "f3483de4-481b-47ac-8d51-f8457fd0bb85", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:21:37.096388 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-d3d4b354-45a6-4080-96ed-5f27bf86c8cf {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:21:37.097219 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd97cfd7c-ce26-40fe-858c-abdf67b8024a', 'tag': 'f3483de4-481b-47ac-8d51-f8457fd0bb85', 'status': 'completed', 'code': 200} Nov 18 18:21:37.111730 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d2ce25c0-fbf0-4dbe-9b0a-a096f85a2033 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:37.144856 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-36e8e349-8b8b-4638-b5a1-220a11e39b47 req-a4cbcccc-9461-4d61-835d-0d4ee7c91fbd tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4687195 Nov 18 18:21:37.182959 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-1c095ed4-cf50-4f2e-b753-ceec54c2b630 None None] Provisioning complete for port 82ade1e6-a8c1-462a-97bb-16499ada8f89 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:37.184237 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1c095ed4-cf50-4f2e-b753-ceec54c2b630 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:37.218816 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-23c9bd0b-2c72-4df5-be92-fccb1163403f service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3339283 Nov 18 18:21:37.235498 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-52eadae0-3bd2-4c4d-8d0f-dc6d5ab7fce0 req-84badc22-a8f4-4397-89af-7a34c6b8a741 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 210 time: 0.0767732 Nov 18 18:21:37.294553 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] For port 82ade1e6-a8c1-462a-97bb-16499ada8f89, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:37.299139 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] For port 82ade1e6-a8c1-462a-97bb-16499ada8f89, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=82ade1e6-a8c1-462a-97bb-16499ada8f89,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:37.312372 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:37.409887 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-680f6016-369b-402d-84be-cb277343d8e3 req-096ccc44-aa5a-42c2-8cfc-058b06b9d05d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 210 time: 0.0974793 Nov 18 18:21:37.482161 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a966be5c-3851-4599-81f7-57253ade65c3 None None] Pushing event updated for resources: {'Port': ['ID=82ade1e6-a8c1-462a-97bb-16499ada8f89,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:37.564943 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a68f63d9-5b8a-4944-9054-ed31c9f92342 req-d5d9e57b-007d-4f0d-825b-847956cd11c6 service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3278074 Nov 18 18:21:37.570847 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-1c095ed4-cf50-4f2e-b753-ceec54c2b630 None None] Port 82ade1e6-a8c1-462a-97bb-16499ada8f89 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:21:37.590611 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:21:37.590741 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9088f7a-5fb8-4880-86cf-020fa0a57553 req-1531489d-d6ac-4a71-b7c4-d51df4871a6d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:37.592485 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:37.611178 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e9088f7a-5fb8-4880-86cf-020fa0a57553 req-1531489d-d6ac-4a71-b7c4-d51df4871a6d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 943 time: 0.2100592 Nov 18 18:21:37.680528 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d2ce25c0-fbf0-4dbe-9b0a-a096f85a2033 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:37.773114 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e9088f7a-5fb8-4880-86cf-020fa0a57553 req-0ac5fa5a-d140-47c3-88c5-245bb312fb0c tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1604168 Nov 18 18:21:37.856920 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:21:37.888118 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-c3f3465f-c66f-49e8-b93a-884f03ec1296 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:37.889782 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-c3f3465f-c66f-49e8-b93a-884f03ec1296 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.31 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 819 time: 0.2421169 Nov 18 18:21:37.905429 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Request body: {'port': {'device_id': 'f1461fa4-a91b-4537-9c81-67ab32f8d50e', 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38', 'admin_state_up': True, 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:37.985586 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2ce25c0-fbf0-4dbe-9b0a-a096f85a2033 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b37e3332-7b99-4faa-bc18-81d45062a954,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:38.032749 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d2ce25c0-fbf0-4dbe-9b0a-a096f85a2033 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:38.039656 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-d2ce25c0-fbf0-4dbe-9b0a-a096f85a2033 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.4101183 Nov 18 18:21:38.042490 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 35954) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:38.058756 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-f85a12de-f2ff-4c0a-ac85-35feae6b993c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Request body: {'security_group_rule': {'security_group_id': 'fa2c021a-c84e-4618-bb5b-faf8330f97f4', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:38.067888 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8ad512-02b7-4e2c-9050-5bdba53a393c req-2c434d0d-2a99-431a-afba-8d1299e1e257 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:38.069744 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-7b8ad512-02b7-4e2c-9050-5bdba53a393c req-2c434d0d-2a99-431a-afba-8d1299e1e257 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 1096 time: 0.3567657 Nov 18 18:21:38.079075 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:38.095970 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Made reservation on behalf of 76c33c7e96d748ee9e7cdd35c33082fa for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:38.102524 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:38.144049 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-e5fa4658-384c-44c6-ab6d-4100e4fc4322 None None] Provisioning complete for port 82ade1e6-a8c1-462a-97bb-16499ada8f89 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:38.144848 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e5fa4658-384c-44c6-ab6d-4100e4fc4322 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:38.291134 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f85a12de-f2ff-4c0a-ac85-35feae6b993c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:38.295297 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e5fa4658-384c-44c6-ab6d-4100e4fc4322 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:38.315396 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:37Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:21:38.318616 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.31', 57035) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:38.357221 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7daf44b-4519-47f8-aa7b-0169d30827b8 None None] The sync data for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi is: [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:37Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:21:38.380172 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-e5fa4658-384c-44c6-ab6d-4100e4fc4322 None None] For port 82ade1e6-a8c1-462a-97bb-16499ada8f89, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=82ade1e6-a8c1-462a-97bb-16499ada8f89,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:38.396206 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e5fa4658-384c-44c6-ab6d-4100e4fc4322 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:38.396375 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b627bee7-04b0-4a31-8ff0-84f976c65917 {{(pid=102688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:21:38.438342 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:38.454196 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.provisioning_blocks [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Transition to ACTIVE for port object b627bee7-04b0-4a31-8ff0-84f976c65917 will not be triggered until provisioned by entity L2. {{(pid=102688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:21:38.468682 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:38.561304 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5fa4658-384c-44c6-ab6d-4100e4fc4322 None None] Pushing event updated for resources: {'Port': ['ID=82ade1e6-a8c1-462a-97bb-16499ada8f89,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:38.610943 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bac4bc23-91fa-4604-bd44-9c91f630c11c req-627e8653-f218-468f-9b70-99d906d057aa tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 210 time: 0.1272109 Nov 18 18:21:38.793464 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Pushing event updated for resources: {'Port': ['ID=b627bee7-04b0-4a31-8ff0-84f976c65917,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:38.853303 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Attempting to bind port b627bee7-04b0-4a31-8ff0-84f976c65917 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:38.853638 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Attempting to bind port b627bee7-04b0-4a31-8ff0-84f976c65917 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:38.853979 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Attempting to bind port b627bee7-04b0-4a31-8ff0-84f976c65917 on network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:38.856580 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8ad512-02b7-4e2c-9050-5bdba53a393c req-2cb244fe-ad49-47b7-8e57-4931eaec5a81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:38.858345 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-7b8ad512-02b7-4e2c-9050-5bdba53a393c req-2cb244fe-ad49-47b7-8e57-4931eaec5a81 service neutron] 10.222.0.31 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 917 time: 0.7779717 Nov 18 18:21:38.866675 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6efedbee-13a2-47f5-98e9-d366ade47ff9 req-3f1fb3dc-6381-46cb-9d74-c6e3750b601d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 210 time: 0.1327388 Nov 18 18:21:38.872687 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Port b627bee7-04b0-4a31-8ff0-84f976c65917 on network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:21:38.873029 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Attempting to bind port b627bee7-04b0-4a31-8ff0-84f976c65917 on network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:38.888837 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Allocated IP 172.20.0.13 (3c8d9a8a-b5ab-438f-b6ad-3b4724905e38/96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4/13fa8d72-ea18-463c-9382-23f28f110133) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:38.937797 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:38.938127 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Checking segment: {'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:38.938522 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Bound using segment: {'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:38.940582 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Bound port: b627bee7-04b0-4a31-8ff0-84f976c65917, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'}}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:38.941305 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:38.968260 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-7b8ad512-02b7-4e2c-9050-5bdba53a393c req-65544826-d614-491d-8dfb-89a7e343dbce service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=f3483de4-481b-47ac-8d51-f8457fd0bb85 HTTP/1.1" status: 200 len: 217 time: 0.0992124 Nov 18 18:21:38.969970 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f85a12de-f2ff-4c0a-ac85-35feae6b993c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:38.984044 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd7c631-2516-470c-ab3a-f6436f87c1d8 req-c284c539-34f7-4dc4-9131-c77816b330f6 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:38.985724 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5dd7c631-2516-470c-ab3a-f6436f87c1d8 req-c284c539-34f7-4dc4-9131-c77816b330f6 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 943 time: 0.5009506 Nov 18 18:21:39.007982 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f85a12de-f2ff-4c0a-ac85-35feae6b993c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:39.040224 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:39.110784 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8ad512-02b7-4e2c-9050-5bdba53a393c req-163d91b6-03ea-41e5-9d51-659e65209223 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:39.113512 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-7b8ad512-02b7-4e2c-9050-5bdba53a393c req-163d91b6-03ea-41e5-9d51-659e65209223 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=488ef4e4-e6f9-414a-b93f-aabd7b232f9e HTTP/1.1" status: 200 len: 855 time: 0.0956149 Nov 18 18:21:39.159833 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] For port b627bee7-04b0-4a31-8ff0-84f976c65917, host hv-cinder-78776, cleared binding levels {{(pid=102688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:39.165092 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-7b8ad512-02b7-4e2c-9050-5bdba53a393c req-bb32978c-0f62-4d31-a9b2-f6ee18571d5d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0429504 Nov 18 18:21:39.189278 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85a12de-f2ff-4c0a-ac85-35feae6b993c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c8b9be31-db32-4f9c-af90-d9503d2dce45,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:39.208591 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701c559e-c6a9-480d-8f74-0d25af402756 req-8bf2b05c-ca1a-42e1-836a-7b03859b9411 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:39.209304 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] For port b627bee7-04b0-4a31-8ff0-84f976c65917, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b627bee7-04b0-4a31-8ff0-84f976c65917,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:39.210430 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-8bf2b05c-ca1a-42e1-836a-7b03859b9411 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.31 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 817 time: 0.8899441 Nov 18 18:21:39.235355 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:39.329563 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5dd7c631-2516-470c-ab3a-f6436f87c1d8 req-495d327a-f061-4ddf-b7f0-f9f8a5b7ed19 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3233163 Nov 18 18:21:39.330121 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:39.330312 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:39.332282 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] 10.222.0.31 "PUT /v2.0/ports/b627bee7-04b0-4a31-8ff0-84f976c65917 HTTP/1.1" status: 200 len: 1093 time: 2.6233764 Nov 18 18:21:39.334439 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cd7419e5-272b-4c8a-a4a2-9b75dc0b9400', 'tag': 'b627bee7-04b0-4a31-8ff0-84f976c65917'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:21:39.342320 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f7cb6b3-b19a-46de-aab5-8a422c0c9527" -d '{"events": [{"name": "network-changed", "server_uuid": "cd7419e5-272b-4c8a-a4a2-9b75dc0b9400", "tag": "b627bee7-04b0-4a31-8ff0-84f976c65917"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:21:39.348829 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f85a12de-f2ff-4c0a-ac85-35feae6b993c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:39.351910 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-f85a12de-f2ff-4c0a-ac85-35feae6b993c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.3073506 Nov 18 18:21:39.359041 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 36012) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:39.370966 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Request body: {'floatingip': {'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:39.385640 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-7b8ad512-02b7-4e2c-9050-5bdba53a393c req-325ac14f-53da-4761-9ac0-aab3f78109ba service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2114596 Nov 18 18:21:39.478319 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73ac8b00-7a90-4d58-a8db-ca2dd0f78506 service neutron] Pushing event updated for resources: {'Port': ['ID=b627bee7-04b0-4a31-8ff0-84f976c65917,revision_number=3']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:39.503205 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:21:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54630a85-3d3c-45ec-8e47-82bd57781576 x-openstack-request-id: req-54630a85-3d3c-45ec-8e47-82bd57781576 {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:21:39.504148 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cd7419e5-272b-4c8a-a4a2-9b75dc0b9400", "tag": "b627bee7-04b0-4a31-8ff0-84f976c65917", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:21:39.504589 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-54630a85-3d3c-45ec-8e47-82bd57781576 {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:21:39.505250 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cd7419e5-272b-4c8a-a4a2-9b75dc0b9400', 'tag': 'b627bee7-04b0-4a31-8ff0-84f976c65917', 'status': 'completed', 'code': 200} Nov 18 18:21:39.521143 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 277548fe-9144-4153-ba17-e53c37a98205 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:21:39.583671 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-94fa8f85-ea6b-4aef-bc89-5258e4452c05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:39.586279 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-94fa8f85-ea6b-4aef-bc89-5258e4452c05 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 1096 time: 0.1958299 Nov 18 18:21:39.642358 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:39.712810 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-155f5f9d-a0cc-4bb7-88ee-2f76090b50f4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b627bee7-04b0-4a31-8ff0-84f976c65917 HTTP/1.1" status: 200 len: 217 time: 0.1126390 Nov 18 18:21:39.727488 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5571579b-5ff4-4952-b4c3-e17ee8a40e17 req-9e0bbf0a-e45c-47f6-844a-60eff6bcbd27 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:39.734747 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5571579b-5ff4-4952-b4c3-e17ee8a40e17 req-9e0bbf0a-e45c-47f6-844a-60eff6bcbd27 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 943 time: 0.7246449 Nov 18 18:21:39.747849 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-7b8ad512-02b7-4e2c-9050-5bdba53a393c req-f13c0d87-71e5-43a3-8ab4-7bddfc637eb0 service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3219299 Nov 18 18:21:39.773006 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 277548fe-9144-4153-ba17-e53c37a98205, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=277548fe-9144-4153-ba17-e53c37a98205,segment=NetworkSegment(75f5638d-c7c3-4b9a-9271-1a7bc4fecb74),segment_id=75f5638d-c7c3-4b9a-9271-1a7bc4fecb74)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:39.813792 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-6c3903bf-065b-45bb-ad47-b09201519e4c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6a79674a70ee4ad7acedc7d4896b413e HTTP/1.1" status: 200 len: 380 time: 0.5882306 Nov 18 18:21:39.816245 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7b43692a-79ed-4ba8-8ddf-caea7120e95c req-70db8176-7593-475b-86d8-dae3f9f6a81e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 210 time: 0.0650413 Nov 18 18:21:39.817165 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '277548fe-9144-4153-ba17-e53c37a98205', 'network_id': '7e134455-4777-4316-bbbd-bb2480fdc6bf', 'port_id': '277548fe-9144-4153-ba17-e53c37a98205', 'mac_address': 'fa:16:3e:4f:28:51', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1340, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '487bf315-c9f3-4691-b915-cf15db298f82', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:21:39.826217 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-ffcb7702-335d-468c-a118-a9fddb29df13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:39.828250 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-ffcb7702-335d-468c-a118-a9fddb29df13 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 HTTP/1.1" status: 200 len: 859 time: 0.1065392 Nov 18 18:21:39.829433 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-701c559e-c6a9-480d-8f74-0d25af402756 req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Request body: {'port': {'device_id': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'admin_state_up': True, 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'security_groups': ['e5005cc1-2b9d-448f-8794-6c9f2b619e80']}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:39.838307 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:39.875272 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-032471df-efdc-4b0a-b4ab-dff6c2e77584 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0364959 Nov 18 18:21:39.946105 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5571579b-5ff4-4952-b4c3-e17ee8a40e17 req-e73e1c9e-17ee-4525-ab17-4a6697fe015f tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2104888 Nov 18 18:21:39.960900 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:39.991233 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 277548fe-9144-4153-ba17-e53c37a98205 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:21:40.037395 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 277548fe-9144-4153-ba17-e53c37a98205, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=277548fe-9144-4153-ba17-e53c37a98205,segment=NetworkSegment(75f5638d-c7c3-4b9a-9271-1a7bc4fecb74),segment_id=75f5638d-c7c3-4b9a-9271-1a7bc4fecb74)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:40.051555 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:40.075007 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-a8cafd77-d7d7-4600-a25b-491c49945c76 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1895440 Nov 18 18:21:40.080502 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c526748a-3d2e-4c79-baf1-f49219399c14 req-8605501b-e483-44bb-9fae-6c06253bd927 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 210 time: 0.0672989 Nov 18 18:21:40.196827 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=277548fe-9144-4153-ba17-e53c37a98205,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:40.211578 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:40.217942 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:40.237017 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 82ade1e6-a8c1-462a-97bb-16499ada8f89 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:40.251203 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-701c559e-c6a9-480d-8f74-0d25af402756 req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Made reservation on behalf of 6a79674a70ee4ad7acedc7d4896b413e for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:40.260678 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-701c559e-c6a9-480d-8f74-0d25af402756 req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:40.286866 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e5f11ca7-3b8c-4844-9b59-754c1ede24a5 req-d3048bd1-51a2-45a0-9366-a47a6d9720c0 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2036667 Nov 18 18:21:40.309211 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:40.313841 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['277548fe-9144-4153-ba17-e53c37a98205'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:21:40.321048 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:40.366412 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:40.370885 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:40.376348 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:40.376896 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:40.383293 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Pushing event updated for resources: {'Port': ['ID=13fa8d72-ea18-463c-9382-23f28f110133,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:40.437804 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f7cb6b3-b19a-46de-aab5-8a422c0c9527 req-a215303d-9d02-4283-81ec-a853ec5d89a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:40.445876 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-6f7cb6b3-b19a-46de-aab5-8a422c0c9527 req-a215303d-9d02-4283-81ec-a853ec5d89a8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 1096 time: 0.0880418 Nov 18 18:21:40.517566 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-868af746-f3e8-47b4-a38d-18c1ef4f2821 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.6159031 Nov 18 18:21:40.540206 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Request body: {'port': {'device_id': 'f1461fa4-a91b-4537-9c81-67ab32f8d50e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:40.551973 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 36050) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:40.656279 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 82ade1e6-a8c1-462a-97bb-16499ada8f89 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:40.656653 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:40.708680 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c3e194-d019-4717-882c-c91773f8ec79 req-d803c2de-b270-4aa5-802c-0a541af5776c tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:40.708853 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-69c3e194-d019-4717-882c-c91773f8ec79 req-d803c2de-b270-4aa5-802c-0a541af5776c tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 944 time: 0.2427387 Nov 18 18:21:40.723482 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-701c559e-c6a9-480d-8f74-0d25af402756 req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Allocated IP 172.20.0.6 (d845755f-6a59-4935-8123-1a70c6e45968/690618f7-2d23-41bc-866f-0d343d1149d2/b8ded38f-97b4-485b-9845-705c1fb9701d) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:40.723691 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f7cb6b3-b19a-46de-aab5-8a422c0c9527 req-787ad804-5ba3-47a9-ac05-54b79bf4015f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:40.728076 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-6f7cb6b3-b19a-46de-aab5-8a422c0c9527 req-787ad804-5ba3-47a9-ac05-54b79bf4015f service neutron] 10.222.0.31 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 921 time: 0.2717342 Nov 18 18:21:40.744236 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Allocated IP 172.27.1.231 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/c21d6cf2-57fc-4203-93f1-43a539d67067) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:40.759123 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:40.814988 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-6f7cb6b3-b19a-46de-aab5-8a422c0c9527 req-b3ac4e14-a19e-49c6-be8a-0622ade9f4a5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b627bee7-04b0-4a31-8ff0-84f976c65917 HTTP/1.1" status: 200 len: 217 time: 0.0796146 Nov 18 18:21:40.922205 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9f719c5a-ce9e-47a1-a9d0-e028d1d363e8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:40.939326 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f7cb6b3-b19a-46de-aab5-8a422c0c9527 req-8e1e3914-f539-46f2-8ec2-f54fdbb9db55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:40.942364 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-6f7cb6b3-b19a-46de-aab5-8a422c0c9527 req-8e1e3914-f539-46f2-8ec2-f54fdbb9db55 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 HTTP/1.1" status: 200 len: 859 time: 0.1191680 Nov 18 18:21:40.971812 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-69c3e194-d019-4717-882c-c91773f8ec79 req-9a884bc9-a8d5-4309-a311-d4789634e687 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2364764 Nov 18 18:21:40.978780 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-6f7cb6b3-b19a-46de-aab5-8a422c0c9527 req-1c87f8da-700e-4a2d-afe7-106a04424110 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0280805 Nov 18 18:21:41.089380 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-6f7cb6b3-b19a-46de-aab5-8a422c0c9527 req-d5f8da44-7c79-4789-9b92-d41270ad3972 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1015611 Nov 18 18:21:41.192038 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-6f7cb6b3-b19a-46de-aab5-8a422c0c9527 req-1931f02a-ba34-466c-beb9-c6899294d2bd service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0954790 Nov 18 18:21:41.219011 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36082) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:41.293163 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.302089 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57e88317-0c84-42d1-bc65-c188a9fb3fd8 req-5c72ba9a-ddb3-40ea-86d8-bc9d35d584be tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:41.303602 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-57e88317-0c84-42d1-bc65-c188a9fb3fd8 req-5c72ba9a-ddb3-40ea-86d8-bc9d35d584be tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 932 time: 0.3506467 Nov 18 18:21:41.325841 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6c091ef9-4974-4d4b-85d5-a3108ac3377c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.360331 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a8c3ba0-15fe-46b3-b4b1-a65fbfd5847a req-09800866-874d-4332-ac25-8faee0c28dda tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:41.361888 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3a8c3ba0-15fe-46b3-b4b1-a65fbfd5847a req-09800866-874d-4332-ac25-8faee0c28dda tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 943 time: 0.2744019 Nov 18 18:21:41.371444 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-701c559e-c6a9-480d-8f74-0d25af402756 req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.400257 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6c091ef9-4974-4d4b-85d5-a3108ac3377c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.404137 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6c091ef9-4974-4d4b-85d5-a3108ac3377c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.443340 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-6c091ef9-4974-4d4b-85d5-a3108ac3377c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=817bef2637a141d880b18087242e526c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2232358 Nov 18 18:21:41.445908 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36086) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:41.452891 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c091ef9-4974-4d4b-85d5-a3108ac3377c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df2fac01-4bd1-410e-9762-13e1dbd146ee,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:41.498042 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3138d031-42be-46f2-ac8e-eca1fbf4eca8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.510249 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9f719c5a-ce9e-47a1-a9d0-e028d1d363e8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.523133 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device f3483de4-481b-47ac-8d51-f8457fd0bb85 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:21:41.523700 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3138d031-42be-46f2-ac8e-eca1fbf4eca8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.534055 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9f719c5a-ce9e-47a1-a9d0-e028d1d363e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.572122 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-57e88317-0c84-42d1-bc65-c188a9fb3fd8 req-1758b582-1402-4787-a3f5-fd602946df4f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2580497 Nov 18 18:21:41.579324 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3138d031-42be-46f2-ac8e-eca1fbf4eca8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.584257 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3138d031-42be-46f2-ac8e-eca1fbf4eca8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.588862 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-3138d031-42be-46f2-ac8e-eca1fbf4eca8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/df2fac01-4bd1-410e-9762-13e1dbd146ee HTTP/1.1" status: 204 len: 168 time: 0.1396716 Nov 18 18:21:41.589150 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.592345 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 277548fe-9144-4153-ba17-e53c37a98205 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:41.603976 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3a8c3ba0-15fe-46b3-b4b1-a65fbfd5847a req-333557a7-66b5-42a2-ac65-054c4553d2b5 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2294726 Nov 18 18:21:41.606735 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3138d031-42be-46f2-ac8e-eca1fbf4eca8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df2fac01-4bd1-410e-9762-13e1dbd146ee,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:41.641547 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-701c559e-c6a9-480d-8f74-0d25af402756 req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.668167 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-9f719c5a-ce9e-47a1-a9d0-e028d1d363e8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1f29ef62d0984965956fe84f0b507a5a&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0785208 Nov 18 18:21:41.670843 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36090) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:41.720893 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:41.734950 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-396f3ca2-ba27-4e88-a140-c066ef84b98a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.754305 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port f3483de4-481b-47ac-8d51-f8457fd0bb85, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f3483de4-481b-47ac-8d51-f8457fd0bb85,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:41.755767 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f719c5a-ce9e-47a1-a9d0-e028d1d363e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f84937b9-ec9e-48a0-8529-b04339b29fa1,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:41.759819 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:41.767586 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-396f3ca2-ba27-4e88-a140-c066ef84b98a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.784398 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:41.788983 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-701c559e-c6a9-480d-8f74-0d25af402756 req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Network d845755f-6a59-4935-8123-1a70c6e45968 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:41.793820 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event updated for resources: {'Port': ['ID=c21d6cf2-57fc-4203-93f1-43a539d67067,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:41.807302 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-701c559e-c6a9-480d-8f74-0d25af402756 req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:41.809981 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-701c559e-c6a9-480d-8f74-0d25af402756 req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:41.825490 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701c559e-c6a9-480d-8f74-0d25af402756 req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:41.826255 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-701c559e-c6a9-480d-8f74-0d25af402756 req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.832395 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': 'f3483de4-481b-47ac-8d51-f8457fd0bb85', 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1', 'port_id': 'f3483de4-481b-47ac-8d51-f8457fd0bb85', 'mac_address': 'fa:16:3e:46:7b:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1303, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '488ef4e4-e6f9-414a-b93f-aabd7b232f9e', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:21:41.836223 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-396f3ca2-ba27-4e88-a140-c066ef84b98a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.838705 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port 277548fe-9144-4153-ba17-e53c37a98205 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:21:41.847865 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-396f3ca2-ba27-4e88-a140-c066ef84b98a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.847865 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-396f3ca2-ba27-4e88-a140-c066ef84b98a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f84937b9-ec9e-48a0-8529-b04339b29fa1 HTTP/1.1" status: 204 len: 168 time: 0.1705365 Nov 18 18:21:41.854156 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 277548fe-9144-4153-ba17-e53c37a98205 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:41.854553 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.869010 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 13fa8d72-ea18-463c-9382-23f28f110133 {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:21:41.882959 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-396f3ca2-ba27-4e88-a140-c066ef84b98a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f84937b9-ec9e-48a0-8529-b04339b29fa1,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:41.949528 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:41.974598 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f3483de4-481b-47ac-8d51-f8457fd0bb85 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:21:42.014776 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.020893 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port f3483de4-481b-47ac-8d51-f8457fd0bb85, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f3483de4-481b-47ac-8d51-f8457fd0bb85,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:42.056446 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2319810 Nov 18 18:21:42.076453 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.098650 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Request body: {'port': {'device_id': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:42.123255 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.184933 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Transition to ACTIVE for port object 13fa8d72-ea18-463c-9382-23f28f110133 will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:21:42.193270 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-125fa93e-5b7b-410c-9cd9-08a55e15fc70 req-fdaa7914-3234-42f3-afc4-97445789e0be tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:42.195565 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-125fa93e-5b7b-410c-9cd9-08a55e15fc70 req-fdaa7914-3234-42f3-afc4-97445789e0be tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 931 time: 0.5210319 Nov 18 18:21:42.196280 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db0db4ea-53e9-4782-81d7-0f89a19aa112 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event updated for resources: {'Port': ['ID=b8ded38f-97b4-485b-9845-705c1fb9701d,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:42.206340 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9aad4c1-c9a9-4ede-b085-5d2c7455014e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '277548fe-9144-4153-ba17-e53c37a98205'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:21:42.211375 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.213831 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.226931 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36114) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:42.250648 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-81d2cb45-9100-4b66-bd4c-fe1f153247c5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.311136 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 277548fe-9144-4153-ba17-e53c37a98205, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=277548fe-9144-4153-ba17-e53c37a98205,segment=NetworkSegment(75f5638d-c7c3-4b9a-9271-1a7bc4fecb74),segment_id=75f5638d-c7c3-4b9a-9271-1a7bc4fecb74)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:42.316890 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=f3483de4-481b-47ac-8d51-f8457fd0bb85,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:42.321456 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-f82f2411-e662-4169-bd76-a40a4c79cb5c None None] Provisioning complete for port b8ded38f-97b4-485b-9845-705c1fb9701d triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:42.322058 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f82f2411-e662-4169-bd76-a40a4c79cb5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.326398 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.385852 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['f3483de4-481b-47ac-8d51-f8457fd0bb85'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:21:42.425792 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-81d2cb45-9100-4b66-bd4c-fe1f153247c5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.441548 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-81d2cb45-9100-4b66-bd4c-fe1f153247c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.507850 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-81d2cb45-9100-4b66-bd4c-fe1f153247c5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6fba0ede3d53434ea3fdf16a5154b95f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2765408 Nov 18 18:21:42.507850 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36126) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:42.514408 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81d2cb45-9100-4b66-bd4c-fe1f153247c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1167e06-2e18-408a-8b13-94df153244a0,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:42.539304 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b32dbbfc-51b8-4493-aff8-38d3b25f0765" -d '{"events": [{"server_uuid": "e9aad4c1-c9a9-4ede-b085-5d2c7455014e", "name": "network-vif-plugged", "status": "completed", "tag": "277548fe-9144-4153-ba17-e53c37a98205"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:21:42.578746 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-f82f2411-e662-4169-bd76-a40a4c79cb5c None None] Port b8ded38f-97b4-485b-9845-705c1fb9701d cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:21:42.587323 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.589005 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.595268 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Pushing event updated for resources: {'Port': ['ID=13fa8d72-ea18-463c-9382-23f28f110133,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:42.601509 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=277548fe-9144-4153-ba17-e53c37a98205,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:42.607015 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb87bac2-5f01-4bd0-84c2-ba8c0f430562 req-4dc60357-3c8a-4f32-921f-9c5c8e52cf6f tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:42.608746 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fb87bac2-5f01-4bd0-84c2-ba8c0f430562 req-4dc60357-3c8a-4f32-921f-9c5c8e52cf6f tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 944 time: 0.4855931 Nov 18 18:21:42.655295 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c0b2dda3-e7d0-4f49-8ad6-c41666ac7857 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.679251 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-125fa93e-5b7b-410c-9cd9-08a55e15fc70 req-ef34aedc-1268-4493-8ed6-9afb1b1beb97 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4695714 Nov 18 18:21:42.710385 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c0b2dda3-e7d0-4f49-8ad6-c41666ac7857 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.730053 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36142) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:42.758016 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-60c8846b-2c49-479c-9957-68e6380b5e00 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.797533 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Attempting to bind port 13fa8d72-ea18-463c-9382-23f28f110133 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:42.798010 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Attempting to bind port 13fa8d72-ea18-463c-9382-23f28f110133 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:42.798561 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Attempting to bind port 13fa8d72-ea18-463c-9382-23f28f110133 on network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:42.832996 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Port 13fa8d72-ea18-463c-9382-23f28f110133 on network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:21:42.833595 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Attempting to bind port 13fa8d72-ea18-463c-9382-23f28f110133 on network 3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:42.850123 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c0b2dda3-e7d0-4f49-8ad6-c41666ac7857 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.856102 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c0b2dda3-e7d0-4f49-8ad6-c41666ac7857 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.860005 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-c0b2dda3-e7d0-4f49-8ad6-c41666ac7857 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c1167e06-2e18-408a-8b13-94df153244a0 HTTP/1.1" status: 204 len: 168 time: 0.3490214 Nov 18 18:21:42.872815 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fb87bac2-5f01-4bd0-84c2-ba8c0f430562 req-6b3bfe0b-178a-4187-ac6b-6e31af132174 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2272506 Nov 18 18:21:42.877531 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-60c8846b-2c49-479c-9957-68e6380b5e00 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.879029 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b2dda3-e7d0-4f49-8ad6-c41666ac7857 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1167e06-2e18-408a-8b13-94df153244a0,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:42.884894 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-60c8846b-2c49-479c-9957-68e6380b5e00 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.886809 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:42.887149 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Checking segment: {'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:42.887534 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Bound using segment: {'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:42.888002 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Bound port: 13fa8d72-ea18-463c-9382-23f28f110133, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1343, 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:42.892468 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:42.977939 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-60c8846b-2c49-479c-9957-68e6380b5e00 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7cd5120d1f9d473bacdcff6774f70783&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2468300 Nov 18 18:21:42.978826 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60c8846b-2c49-479c-9957-68e6380b5e00 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=164d0244-ad49-464d-ac12-feaea4f7761d,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:42.991535 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36148) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:43.005378 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:21:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-145ce162-e939-450a-8797-df00ec145b6d x-openstack-request-id: req-145ce162-e939-450a-8797-df00ec145b6d {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:21:43.005784 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9aad4c1-c9a9-4ede-b085-5d2c7455014e", "name": "network-vif-plugged", "status": "completed", "tag": "277548fe-9144-4153-ba17-e53c37a98205", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:21:43.006141 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-145ce162-e939-450a-8797-df00ec145b6d {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:21:43.006716 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9aad4c1-c9a9-4ede-b085-5d2c7455014e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '277548fe-9144-4153-ba17-e53c37a98205', 'code': 200} Nov 18 18:21:43.106871 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e83d188c-4599-4c09-8d6a-abd3c928bfd6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.132078 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e83d188c-4599-4c09-8d6a-abd3c928bfd6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.195151 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36152) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:43.204644 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e83d188c-4599-4c09-8d6a-abd3c928bfd6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.207835 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e83d188c-4599-4c09-8d6a-abd3c928bfd6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.210536 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-e83d188c-4599-4c09-8d6a-abd3c928bfd6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/164d0244-ad49-464d-ac12-feaea4f7761d HTTP/1.1" status: 204 len: 168 time: 0.2168729 Nov 18 18:21:43.248265 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.260887 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2751edf7-ca23-4331-ac86-6aa0f3f57123 req-159504a3-e1f4-41b6-bbb7-628bc4df9e05 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:43.262090 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2751edf7-ca23-4331-ac86-6aa0f3f57123 req-159504a3-e1f4-41b6-bbb7-628bc4df9e05 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 944 time: 0.2614822 Nov 18 18:21:43.279838 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.284640 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] For port 13fa8d72-ea18-463c-9382-23f28f110133, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:43.287351 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e83d188c-4599-4c09-8d6a-abd3c928bfd6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=164d0244-ad49-464d-ac12-feaea4f7761d,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:43.316438 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf106e2-6ecb-4a60-ad99-72608883d455 req-1c4bec33-3135-4233-bcff-2773e33cbb25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:43.319712 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-4bf106e2-6ecb-4a60-ad99-72608883d455 req-1c4bec33-3135-4233-bcff-2773e33cbb25 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 1098 time: 0.1072581 Nov 18 18:21:43.348258 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-4bf106e2-6ecb-4a60-ad99-72608883d455 req-b3a89d30-c8cb-4d1d-b308-7d70edf30d74 service neutron] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.350387 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] For port 13fa8d72-ea18-463c-9382-23f28f110133, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=13fa8d72-ea18-463c-9382-23f28f110133,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:43.360151 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beebfe15-6008-45ec-865b-b6ebf7bd0fdd req-f44e9967-2730-4edd-95d6-d0c835dbc96b tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:43.361615 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-beebfe15-6008-45ec-865b-b6ebf7bd0fdd req-f44e9967-2730-4edd-95d6-d0c835dbc96b tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 944 time: 0.2405293 Nov 18 18:21:43.369257 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.379897 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.429615 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event updated for resources: {'Port': ['ID=c21d6cf2-57fc-4203-93f1-43a539d67067,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:43.455865 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:43.456832 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.457926 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] 10.222.0.31 "PUT /v2.0/ports/13fa8d72-ea18-463c-9382-23f28f110133 HTTP/1.1" status: 200 len: 1094 time: 2.9263031 Nov 18 18:21:43.461767 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f1461fa4-a91b-4537-9c81-67ab32f8d50e', 'tag': '13fa8d72-ea18-463c-9382-23f28f110133'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:21:43.464061 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e2c1fb5-e279-4016-aac9-54086af5ecd1" -d '{"events": [{"name": "network-changed", "server_uuid": "f1461fa4-a91b-4537-9c81-67ab32f8d50e", "tag": "13fa8d72-ea18-463c-9382-23f28f110133"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:21:43.484122 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ef75877a-5920-4409-b9c5-c636a611cb11 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.492937 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.494167 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-501e5ecc-d285-418d-93d8-734388b4d808 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.1301253 Nov 18 18:21:43.513140 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2751edf7-ca23-4331-ac86-6aa0f3f57123 req-73afdd34-4605-4271-9980-88e512bcbf4c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2383094 Nov 18 18:21:43.513365 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-4bf106e2-6ecb-4a60-ad99-72608883d455 req-b3a89d30-c8cb-4d1d-b308-7d70edf30d74 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.525911 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-4bf106e2-6ecb-4a60-ad99-72608883d455 req-b3a89d30-c8cb-4d1d-b308-7d70edf30d74 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.527275 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b627bee7-04b0-4a31-8ff0-84f976c65917 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:21:43.530240 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device f3483de4-481b-47ac-8d51-f8457fd0bb85 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:43.608777 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-4bf106e2-6ecb-4a60-ad99-72608883d455 req-b3a89d30-c8cb-4d1d-b308-7d70edf30d74 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2821016 Nov 18 18:21:43.613063 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a89d30-c8cb-4d1d-b308-7d70edf30d74 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=b26f9314-d63a-4a67-bfdc-599fe267bfb8,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:43.623578 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:21:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0107789-4560-4a1b-bbb5-3b4177713572 x-openstack-request-id: req-e0107789-4560-4a1b-bbb5-3b4177713572 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:21:43.624422 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f1461fa4-a91b-4537-9c81-67ab32f8d50e", "tag": "13fa8d72-ea18-463c-9382-23f28f110133", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:21:43.624841 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-e0107789-4560-4a1b-bbb5-3b4177713572 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:21:43.625554 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f1461fa4-a91b-4537-9c81-67ab32f8d50e', 'tag': '13fa8d72-ea18-463c-9382-23f28f110133', 'status': 'completed', 'code': 200} Nov 18 18:21:43.655719 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-beebfe15-6008-45ec-865b-b6ebf7bd0fdd req-eb01943c-1446-4fba-9be7-90553a29e50d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2791812 Nov 18 18:21:43.680698 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b8ded38f-97b4-485b-9845-705c1fb9701d {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:21:43.685061 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-117a47b2-5fdd-4eb8-ba02-bae10be41847 service neutron] Pushing event updated for resources: {'Port': ['ID=13fa8d72-ea18-463c-9382-23f28f110133,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:43.693882 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.706903 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-30467f22-f371-4b46-9085-b7f6883e62f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:43.708469 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-30467f22-f371-4b46-9085-b7f6883e62f9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 1097 time: 0.1893733 Nov 18 18:21:43.713757 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Transition to ACTIVE for port object b8ded38f-97b4-485b-9845-705c1fb9701d will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:21:43.732396 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.750677 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ef75877a-5920-4409-b9c5-c636a611cb11 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.769917 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ef75877a-5920-4409-b9c5-c636a611cb11 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.823361 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port f3483de4-481b-47ac-8d51-f8457fd0bb85 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:21:43.835534 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port f3483de4-481b-47ac-8d51-f8457fd0bb85 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:43.836116 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.848566 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-ef75877a-5920-4409-b9c5-c636a611cb11 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=27267b7fd538423587ecd9ee294d1f08&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6516991 Nov 18 18:21:43.856264 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36182) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:43.903475 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef75877a-5920-4409-b9c5-c636a611cb11 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f0e6a9d-1bb0-4db5-a995-e1587f0ec9e4,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:43.905609 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b627bee7-04b0-4a31-8ff0-84f976c65917, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b627bee7-04b0-4a31-8ff0-84f976c65917,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:43.950852 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': 'b627bee7-04b0-4a31-8ff0-84f976c65917', 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38', 'port_id': 'b627bee7-04b0-4a31-8ff0-84f976c65917', 'mac_address': 'fa:16:3e:1f:ba:e1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1343, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:21:43.960522 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-befd6c57-e002-44ef-9fcd-62c28e41ad85 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:43.987157 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-befd6c57-e002-44ef-9fcd-62c28e41ad85 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:44.062320 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-befd6c57-e002-44ef-9fcd-62c28e41ad85 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:44.065160 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-befd6c57-e002-44ef-9fcd-62c28e41ad85 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:44.066342 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-befd6c57-e002-44ef-9fcd-62c28e41ad85 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1f0e6a9d-1bb0-4db5-a995-e1587f0ec9e4 HTTP/1.1" status: 204 len: 168 time: 0.2088273 Nov 18 18:21:44.067109 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-c53b0bfb-fb4e-4ab8-a62e-2dbf8dad38ea service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=13fa8d72-ea18-463c-9382-23f28f110133 HTTP/1.1" status: 200 len: 217 time: 0.2274630 Nov 18 18:21:44.080893 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-befd6c57-e002-44ef-9fcd-62c28e41ad85 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f0e6a9d-1bb0-4db5-a995-e1587f0ec9e4,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:44.105279 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:44.109531 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:44.109632 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Pushing event updated for resources: {'Port': ['ID=b8ded38f-97b4-485b-9845-705c1fb9701d,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:44.153498 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b627bee7-04b0-4a31-8ff0-84f976c65917 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:21:44.196649 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b627bee7-04b0-4a31-8ff0-84f976c65917, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b627bee7-04b0-4a31-8ff0-84f976c65917,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:44.212696 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:44.212799 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-6ac6068c-841f-4e02-8337-d2e7c1542569 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1044095394&fields=id&tenant_id=1bab99f3344342578dc7b1c29b1ced7e HTTP/1.1" status: 200 len: 267 time: 0.3513982 Nov 18 18:21:44.215774 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port f3483de4-481b-47ac-8d51-f8457fd0bb85, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f3483de4-481b-47ac-8d51-f8457fd0bb85,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:44.217076 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Attempting to bind port b8ded38f-97b4-485b-9845-705c1fb9701d on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:44.217490 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Attempting to bind port b8ded38f-97b4-485b-9845-705c1fb9701d by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:44.217728 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Attempting to bind port b8ded38f-97b4-485b-9845-705c1fb9701d on network d845755f-6a59-4935-8123-1a70c6e45968 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:44.233353 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec36e0f8-7fb9-44f5-ab6e-6c97ddf6b123 req-a53012e2-13e8-426d-b5fc-7fc85672c4a8 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:44.240428 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ec36e0f8-7fb9-44f5-ab6e-6c97ddf6b123 req-a53012e2-13e8-426d-b5fc-7fc85672c4a8 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.4019175 Nov 18 18:21:44.244161 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Port b8ded38f-97b4-485b-9845-705c1fb9701d on network d845755f-6a59-4935-8123-1a70c6e45968 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:21:44.244665 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Attempting to bind port b8ded38f-97b4-485b-9845-705c1fb9701d on network d845755f-6a59-4935-8123-1a70c6e45968 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:44.245401 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:44.253698 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-7c3c9306-9f13-4be3-8f96-0392c11c2b6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:44.255100 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-7c3c9306-9f13-4be3-8f96-0392c11c2b6f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 HTTP/1.1" status: 200 len: 859 time: 0.1652119 Nov 18 18:21:44.287005 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=b627bee7-04b0-4a31-8ff0-84f976c65917,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:44.291000 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:44.291330 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Checking segment: {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:44.291885 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Bound using segment: {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:44.292491 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Bound port: b8ded38f-97b4-485b-9845-705c1fb9701d, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:44.292993 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:44.330153 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-88e990b9-9bd1-431a-b104-5377544d6a68 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0632195 Nov 18 18:21:44.345055 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=f3483de4-481b-47ac-8d51-f8457fd0bb85,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:44.445021 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['b627bee7-04b0-4a31-8ff0-84f976c65917'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:21:44.473308 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ec36e0f8-7fb9-44f5-ab6e-6c97ddf6b123 req-8c6db5de-d65d-4f9e-9595-9af04e893c0e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2256694 Nov 18 18:21:44.585492 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-8955bdc2-5e01-4a92-8823-e6ddbcdd1732 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:44.586990 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-8955bdc2-5e01-4a92-8823-e6ddbcdd1732 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/networks?id=f2a08e65-1c6c-43fe-a019-78643e62bd9f HTTP/1.1" status: 200 len: 810 time: 0.3446023 Nov 18 18:21:44.594370 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:44.644018 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b8ded38f-97b4-485b-9845-705c1fb9701d,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:44.649026 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-58e240e6-69cb-48d9-bd65-697e7fd434a0 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3058558 Nov 18 18:21:44.654058 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-eeb12b36-9135-4945-9395-ad81f22984f8 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/quotas/1bab99f3344342578dc7b1c29b1ced7e HTTP/1.1" status: 200 len: 375 time: 0.0374162 Nov 18 18:21:44.654058 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:44.655322 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 36214) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:44.754008 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:44.754632 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:44.756119 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] 10.222.0.31 "PUT /v2.0/ports/b8ded38f-97b4-485b-9845-705c1fb9701d HTTP/1.1" status: 200 len: 1093 time: 2.6658087 Nov 18 18:21:44.764986 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5a7a7626-b555-43eb-a9ed-d8b7f2b64222 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:44.806952 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf8c1381-5216-4177-8304-af9a1885e35e req-0ba0f285-3552-4975-b349-a831bb6db499 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:44.808559 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bf8c1381-5216-4177-8304-af9a1885e35e req-0ba0f285-3552-4975-b349-a831bb6db499 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 945 time: 0.2191219 Nov 18 18:21:45.008513 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd97cfd7c-ce26-40fe-858c-abdf67b8024a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f3483de4-481b-47ac-8d51-f8457fd0bb85'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:21:45.011890 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2dbd2f65-c570-4fdc-8d4a-7b52bfac3f7e" -d '{"events": [{"server_uuid": "d97cfd7c-ce26-40fe-858c-abdf67b8024a", "name": "network-vif-plugged", "status": "completed", "tag": "f3483de4-481b-47ac-8d51-f8457fd0bb85"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:21:45.075958 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28d3b375-7e09-4836-8894-556ef669bfa2 service neutron] Pushing event updated for resources: {'Port': ['ID=b8ded38f-97b4-485b-9845-705c1fb9701d,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:45.137588 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-a021c7a9-31f6-4314-82b7-a6809a99af8e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=1bab99f3344342578dc7b1c29b1ced7e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.4511464 Nov 18 18:21:45.176322 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7723513a-a6b1-4680-9b14-6b5b11b9b9cc req-880025f4-8398-4eb7-bfe8-6d2c7c5c06a7 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5135863 Nov 18 18:21:45.216310 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701c559e-c6a9-480d-8f74-0d25af402756 req-1f51cff7-7da0-4b37-ba01-acf75421a42f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:45.218013 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-1f51cff7-7da0-4b37-ba01-acf75421a42f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 1096 time: 0.4069328 Nov 18 18:21:45.231665 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bf8c1381-5216-4177-8304-af9a1885e35e req-69392b8d-8698-4a0e-961e-0e7c53db7e95 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3951013 Nov 18 18:21:45.325612 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-8f58f7c2-e01c-45b9-9687-535c80fc0bfd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b8ded38f-97b4-485b-9845-705c1fb9701d HTTP/1.1" status: 200 len: 217 time: 0.0913510 Nov 18 18:21:45.448716 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5a7a7626-b555-43eb-a9ed-d8b7f2b64222 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:45.452767 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-d17774fc-e698-4bf9-851c-3189c7c3c326 service neutron] 10.222.0.82 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2914453 Nov 18 18:21:45.462126 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5a7a7626-b555-43eb-a9ed-d8b7f2b64222 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:45.465722 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e2c1fb5-e279-4016-aac9-54086af5ecd1 req-8f391ce3-934a-465e-afc0-4f19601408bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:45.467369 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0e2c1fb5-e279-4016-aac9-54086af5ecd1 req-8f391ce3-934a-465e-afc0-4f19601408bd service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 1097 time: 0.2216198 Nov 18 18:21:45.478897 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701c559e-c6a9-480d-8f74-0d25af402756 req-32106f19-714a-4a65-871f-31c0376dea2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:45.480307 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-32106f19-714a-4a65-871f-31c0376dea2b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 200 len: 856 time: 0.1323323 Nov 18 18:21:45.505757 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36254) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:45.541082 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b627bee7-04b0-4a31-8ff0-84f976c65917 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:45.562470 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bd8fb81-0c0c-4435-9383-b70e92f43a6c req-fbdb29cb-b9fe-4976-b9a7-bf0c13ae0f8a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:45.563571 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8bd8fb81-0c0c-4435-9383-b70e92f43a6c req-fbdb29cb-b9fe-4976-b9a7-bf0c13ae0f8a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 944 time: 0.2370839 Nov 18 18:21:45.614643 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port b627bee7-04b0-4a31-8ff0-84f976c65917 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:21:45.620056 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port b627bee7-04b0-4a31-8ff0-84f976c65917 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:45.621792 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:45.632740 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-5a7a7626-b555-43eb-a9ed-d8b7f2b64222 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=307ad15cad644ab6a7008ef87fb047c1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9695082 Nov 18 18:21:45.632740 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:21:45.633005 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-235964e2-183b-4ffd-9b08-55e1b6e2dac6" -d '{"events": [{"name": "network-changed", "server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:21:45.633404 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36260) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:45.670086 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a7a7626-b555-43eb-a9ed-d8b7f2b64222 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=334d98b5-a882-4aa6-90c5-75cf6e023110,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:45.706943 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-68d11480-413b-496b-831e-352a5dd7c13c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:45.741700 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-68d11480-413b-496b-831e-352a5dd7c13c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:45.762739 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:45.790839 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-62c70151-7d84-48c9-acca-f0027cedfd55 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:45.796976 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b627bee7-04b0-4a31-8ff0-84f976c65917, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b627bee7-04b0-4a31-8ff0-84f976c65917,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:45.805778 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:45.837697 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701c559e-c6a9-480d-8f74-0d25af402756 req-35fefa15-e35e-4cd9-ba03-87f363e7d807 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:45.839281 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-35fefa15-e35e-4cd9-ba03-87f363e7d807 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d845755f-6a59-4935-8123-1a70c6e45968&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3231223 Nov 18 18:21:45.846148 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-a9f21e5d-9360-468b-9a24-3797eb2e5b8b service neutron] 10.222.0.82 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3852804 Nov 18 18:21:45.852295 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8bd8fb81-0c0c-4435-9383-b70e92f43a6c req-42629f5d-85ba-47ac-abd2-82c4a4b27761 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2479699 Nov 18 18:21:45.861882 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e2c1fb5-e279-4016-aac9-54086af5ecd1 req-975e3bbe-a27e-43ef-8063-622d1fc102f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:45.864185 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0e2c1fb5-e279-4016-aac9-54086af5ecd1 req-975e3bbe-a27e-43ef-8063-622d1fc102f3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 921 time: 0.3627164 Nov 18 18:21:45.875120 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-68d11480-413b-496b-831e-352a5dd7c13c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:45.878194 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-68d11480-413b-496b-831e-352a5dd7c13c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:45.879544 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-68d11480-413b-496b-831e-352a5dd7c13c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/334d98b5-a882-4aa6-90c5-75cf6e023110 HTTP/1.1" status: 204 len: 168 time: 0.2449234 Nov 18 18:21:45.898394 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68d11480-413b-496b-831e-352a5dd7c13c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=334d98b5-a882-4aa6-90c5-75cf6e023110,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:45.925936 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-62c70151-7d84-48c9-acca-f0027cedfd55 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:45.934438 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-62c70151-7d84-48c9-acca-f0027cedfd55 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:45.985356 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=b627bee7-04b0-4a31-8ff0-84f976c65917,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:45.985544 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0e2c1fb5-e279-4016-aac9-54086af5ecd1 req-b6ed67c6-2ff6-4dd5-b7c1-46b087494e90 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=13fa8d72-ea18-463c-9382-23f28f110133 HTTP/1.1" status: 200 len: 217 time: 0.1042287 Nov 18 18:21:46.021240 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-62c70151-7d84-48c9-acca-f0027cedfd55 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b8cc6ac6bc2e4326acd0182e7e9ee5f6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5117655 Nov 18 18:21:46.021240 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62c70151-7d84-48c9-acca-f0027cedfd55 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63c73005-4826-4f34-993c-f5dc1c1ee0cb,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:46.024370 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36274) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:46.082044 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1d8557b5-0168-4f1f-bf9c-35486fcf8902 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:46.123593 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1d8557b5-0168-4f1f-bf9c-35486fcf8902 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:46.197786 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1d8557b5-0168-4f1f-bf9c-35486fcf8902 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:46.198850 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e2c1fb5-e279-4016-aac9-54086af5ecd1 req-54b91080-708f-4cfe-84bc-22a29cf0a394 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:46.200482 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0e2c1fb5-e279-4016-aac9-54086af5ecd1 req-54b91080-708f-4cfe-84bc-22a29cf0a394 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 HTTP/1.1" status: 200 len: 859 time: 0.1991076 Nov 18 18:21:46.201316 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1d8557b5-0168-4f1f-bf9c-35486fcf8902 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:46.206288 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-1d8557b5-0168-4f1f-bf9c-35486fcf8902 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/63c73005-4826-4f34-993c-f5dc1c1ee0cb HTTP/1.1" status: 204 len: 168 time: 0.1808305 Nov 18 18:21:46.218719 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:21:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0d776103-d08c-4157-830a-db5070b60ce7 x-openstack-request-id: req-0d776103-d08c-4157-830a-db5070b60ce7 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:21:46.219192 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d97cfd7c-ce26-40fe-858c-abdf67b8024a", "name": "network-vif-plugged", "status": "completed", "tag": "f3483de4-481b-47ac-8d51-f8457fd0bb85", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:21:46.219366 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-0d776103-d08c-4157-830a-db5070b60ce7 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:21:46.219920 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd97cfd7c-ce26-40fe-858c-abdf67b8024a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f3483de4-481b-47ac-8d51-f8457fd0bb85', 'code': 200} Nov 18 18:21:46.220743 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d8557b5-0168-4f1f-bf9c-35486fcf8902 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63c73005-4826-4f34-993c-f5dc1c1ee0cb,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:46.244732 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-209345be-1ad7-45da-905f-fa682360baac req-44c06486-6340-4ffc-a5fc-df1b7113c970 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:46.247246 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-209345be-1ad7-45da-905f-fa682360baac req-44c06486-6340-4ffc-a5fc-df1b7113c970 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 945 time: 0.2256110 Nov 18 18:21:46.266532 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0e2c1fb5-e279-4016-aac9-54086af5ecd1 req-0f1a10a1-a95d-41b3-8d15-60155b59b61e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0491390 Nov 18 18:21:46.269079 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-34f21aac-19f8-4547-9374-d4bd9b793aa0 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4154453 Nov 18 18:21:46.434243 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c3bf1e9-7c30-409e-a593-6e2d706d01b5 req-ef1f96b9-e166-46b5-ac7e-7ab3b8d52927 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:46.437084 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-7c3bf1e9-7c30-409e-a593-6e2d706d01b5 req-ef1f96b9-e166-46b5-ac7e-7ab3b8d52927 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 1098 time: 0.0567372 Nov 18 18:21:46.454930 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-209345be-1ad7-45da-905f-fa682360baac req-4b6ff0c8-c53b-40ec-9bcb-492602da58bb tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1914170 Nov 18 18:21:46.510357 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-701c559e-c6a9-480d-8f74-0d25af402756 req-4384cc36-edac-4bc4-86ca-699985838ff5 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2286401 Nov 18 18:21:46.512954 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0e2c1fb5-e279-4016-aac9-54086af5ecd1 req-dafa6a82-2bb0-4182-aed0-ec69b7d42900 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2302506 Nov 18 18:21:46.527600 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46ca20e4-367e-4b3d-836c-903f456185b1 req-e0b5a66c-e7b4-4577-bb63-ddfae3065939 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:46.538271 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-46ca20e4-367e-4b3d-836c-903f456185b1 req-e0b5a66c-e7b4-4577-bb63-ddfae3065939 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.1068249 Nov 18 18:21:46.542360 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-7c3bf1e9-7c30-409e-a593-6e2d706d01b5 req-8463564c-dedd-4e61-a6c6-ca39a3e3f522 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0958886 Nov 18 18:21:46.574213 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:21:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-36490678-ec1a-46e4-a2ff-32a4abdc991f x-openstack-request-id: req-36490678-ec1a-46e4-a2ff-32a4abdc991f {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:21:46.574507 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:21:46.574756 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-36490678-ec1a-46e4-a2ff-32a4abdc991f {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:21:46.575144 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'status': 'completed', 'code': 200} Nov 18 18:21:46.672168 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ea5354f4-c5f4-4700-9de1-2793e0b2cbd5 req-0ba5ef6f-1d15-435e-b70a-2f829123a678 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 210 time: 0.0338614 Nov 18 18:21:46.683743 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-46ca20e4-367e-4b3d-836c-903f456185b1 req-3660b29a-c382-4752-8b49-f1f61caa93a2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1442547 Nov 18 18:21:46.726295 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0e2c1fb5-e279-4016-aac9-54086af5ecd1 req-f39a08c7-4f93-4a9c-a4c0-d69662931a2b service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1834848 Nov 18 18:21:46.895614 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235964e2-183b-4ffd-9b08-55e1b6e2dac6 req-ba1ce050-b7c8-4c99-a7c2-fe86b3a19966 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:46.895614 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-235964e2-183b-4ffd-9b08-55e1b6e2dac6 req-ba1ce050-b7c8-4c99-a7c2-fe86b3a19966 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 1096 time: 0.1169798 Nov 18 18:21:46.909648 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-848daedc-aefd-4f66-9033-2783701bd0aa req-ad1fc61f-badd-4eb5-8a51-16791708dfb4 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:46.918258 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-848daedc-aefd-4f66-9033-2783701bd0aa req-ad1fc61f-badd-4eb5-8a51-16791708dfb4 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 945 time: 0.1295867 Nov 18 18:21:47.079681 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-848daedc-aefd-4f66-9033-2783701bd0aa req-323c3ef8-ed06-43f2-992e-684dbbd229f2 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1604187 Nov 18 18:21:47.160632 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-226d2240-008b-47c3-908b-5e18ce5b0092 req-6f874064-dd1b-479a-8bfc-d435f385d082 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:47.176470 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-226d2240-008b-47c3-908b-5e18ce5b0092 req-6f874064-dd1b-479a-8bfc-d435f385d082 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 944 time: 0.2102239 Nov 18 18:21:47.453018 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235964e2-183b-4ffd-9b08-55e1b6e2dac6 req-93a66b10-c5fb-4db4-98e2-f3dd80f69602 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:47.454653 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-235964e2-183b-4ffd-9b08-55e1b6e2dac6 req-93a66b10-c5fb-4db4-98e2-f3dd80f69602 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 919 time: 0.5335190 Nov 18 18:21:47.539968 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 13fa8d72-ea18-463c-9382-23f28f110133 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:21:47.584278 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-235964e2-183b-4ffd-9b08-55e1b6e2dac6 req-a1a56c96-73ca-4374-aaa3-e9457554ff2c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b8ded38f-97b4-485b-9845-705c1fb9701d HTTP/1.1" status: 200 len: 217 time: 0.1139112 Nov 18 18:21:47.614820 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-226d2240-008b-47c3-908b-5e18ce5b0092 req-feda53ea-9185-4dcf-99fd-01b231180d2d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4372489 Nov 18 18:21:47.901679 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9b774ce-71d6-4383-8392-d41f14020cfa req-8d4051ba-e819-4a21-b06e-63845f1f470a tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:47.903622 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-10361810-9258-4a51-98a7-af978baa9cff tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:47.909061 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-10361810-9258-4a51-98a7-af978baa9cff tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.31 "GET /v2.0/networks?id=f2a08e65-1c6c-43fe-a019-78643e62bd9f HTTP/1.1" status: 200 len: 810 time: 0.2653823 Nov 18 18:21:47.910848 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a9b774ce-71d6-4383-8392-d41f14020cfa req-8d4051ba-e819-4a21-b06e-63845f1f470a tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 945 time: 0.2774305 Nov 18 18:21:47.937597 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 13fa8d72-ea18-463c-9382-23f28f110133, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=13fa8d72-ea18-463c-9382-23f28f110133,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:47.945413 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235964e2-183b-4ffd-9b08-55e1b6e2dac6 req-a06f7daf-7025-4828-9d35-702f2fec029f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:47.946957 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-235964e2-183b-4ffd-9b08-55e1b6e2dac6 req-a06f7daf-7025-4828-9d35-702f2fec029f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 200 len: 856 time: 0.3312018 Nov 18 18:21:47.969935 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '13fa8d72-ea18-463c-9382-23f28f110133', 'network_id': '3c8d9a8a-b5ab-438f-b6ad-3b4724905e38', 'port_id': '13fa8d72-ea18-463c-9382-23f28f110133', 'mac_address': 'fa:16:3e:fc:16:38', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1343, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:21:48.019635 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8136df33-f033-4c34-8e0c-a24f80cea10b req-d40d3bdf-526b-4392-a641-5c319f397615 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 210 time: 0.1694884 Nov 18 18:21:48.055647 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:48.084037 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 13fa8d72-ea18-463c-9382-23f28f110133 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:21:48.111755 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-bd01d9ae-cd71-4d4c-aa60-398225548804 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1bab99f3344342578dc7b1c29b1ced7e HTTP/1.1" status: 200 len: 380 time: 0.1858993 Nov 18 18:21:48.133746 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Request body: {'port': {'device_id': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'admin_state_up': True, 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'security_groups': ['fa2c021a-c84e-4618-bb5b-faf8330f97f4']}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:48.135432 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 13fa8d72-ea18-463c-9382-23f28f110133, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=13fa8d72-ea18-463c-9382-23f28f110133,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:48.145671 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:48.220971 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cd7419e5-272b-4c8a-a4a2-9b75dc0b9400', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b627bee7-04b0-4a31-8ff0-84f976c65917'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:21:48.223336 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02510da9-a3be-4a81-a0ce-dfbb47259c7c" -d '{"events": [{"server_uuid": "cd7419e5-272b-4c8a-a4a2-9b75dc0b9400", "name": "network-vif-plugged", "status": "completed", "tag": "b627bee7-04b0-4a31-8ff0-84f976c65917"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:21:48.262907 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235964e2-183b-4ffd-9b08-55e1b6e2dac6 req-f2787e9f-0e0a-4c38-ba44-17b0b4d5b52a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:48.265555 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-235964e2-183b-4ffd-9b08-55e1b6e2dac6 req-f2787e9f-0e0a-4c38-ba44-17b0b4d5b52a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d845755f-6a59-4935-8123-1a70c6e45968&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2770541 Nov 18 18:21:48.269087 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=13fa8d72-ea18-463c-9382-23f28f110133,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:48.295501 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Made reservation on behalf of 1bab99f3344342578dc7b1c29b1ced7e for: {'port': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:21:48.299685 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:48.352986 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a9b774ce-71d6-4383-8392-d41f14020cfa req-c83efc2c-3bec-436b-af29-aa7592756966 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4357593 Nov 18 18:21:48.381417 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['13fa8d72-ea18-463c-9382-23f28f110133'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:21:48.407899 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44756390-078f-438f-8754-7ab4fa41cd2c req-9871de82-42e0-463e-bf2d-e12f657915b6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:48.412080 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-44756390-078f-438f-8754-7ab4fa41cd2c req-9871de82-42e0-463e-bf2d-e12f657915b6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.2538996 Nov 18 18:21:48.493111 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:21:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-67b4f65c-8589-48a7-9575-762d86262b7d x-openstack-request-id: req-67b4f65c-8589-48a7-9575-762d86262b7d {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:21:48.493810 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cd7419e5-272b-4c8a-a4a2-9b75dc0b9400", "name": "network-vif-plugged", "status": "completed", "tag": "b627bee7-04b0-4a31-8ff0-84f976c65917", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:21:48.494081 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-67b4f65c-8589-48a7-9575-762d86262b7d {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:21:48.494461 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cd7419e5-272b-4c8a-a4a2-9b75dc0b9400', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b627bee7-04b0-4a31-8ff0-84f976c65917', 'code': 200} Nov 18 18:21:48.531580 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Allocated IP 172.20.0.4 (f2a08e65-1c6c-43fe-a019-78643e62bd9f/53535ce7-7c2a-450f-87e4-d092908ff080/d5a1ed38-73b7-489f-8676-f9b3ae9bd34f) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:21:48.591895 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-44756390-078f-438f-8754-7ab4fa41cd2c req-5dd134af-4ef2-424b-8d26-cb25e5d5e393 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1699398 Nov 18 18:21:48.613878 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-235964e2-183b-4ffd-9b08-55e1b6e2dac6 req-cb0a651c-4e99-4782-88ea-b4c9ac779d71 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3368490 Nov 18 18:21:48.837470 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:48.879893 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:48.922388 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-235964e2-183b-4ffd-9b08-55e1b6e2dac6 req-3b75dac1-1634-4aa8-9f73-f242bfb0e053 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3001397 Nov 18 18:21:48.939431 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-330b5da2-819f-4589-9271-afa351b199f4 req-724186c3-b47e-47cb-835e-8c4a7e5e0cd6 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:48.948083 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-330b5da2-819f-4589-9271-afa351b199f4 req-724186c3-b47e-47cb-835e-8c4a7e5e0cd6 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 945 time: 0.1878400 Nov 18 18:21:48.951835 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Network f2a08e65-1c6c-43fe-a019-78643e62bd9f is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:21:48.958910 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-128a7633-0b8f-44bd-929e-bb35cc3c779b req-34566adf-c5a9-44bb-85f4-47e13a7975a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:48.960320 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event updated for resources: {'Port': ['ID=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:48.961354 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-128a7633-0b8f-44bd-929e-bb35cc3c779b req-34566adf-c5a9-44bb-85f4-47e13a7975a3 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 1098 time: 0.2099972 Nov 18 18:21:48.963144 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:21:48.965155 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:21:48.971401 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:48.972172 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:48.995498 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-c24a0522-b49a-4804-aff3-8c2bfc957cc2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8781691 Nov 18 18:21:49.009967 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Request body: {'port': {'device_id': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:21:49.044425 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-330b5da2-819f-4589-9271-afa351b199f4 req-92a58d3b-da96-45b0-97d6-4ce8ff9d159a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0954223 Nov 18 18:21:49.095823 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-128a7633-0b8f-44bd-929e-bb35cc3c779b req-792316da-7b27-49c1-ad25-c50ef59e7096 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1263430 Nov 18 18:21:49.128481 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:49.188428 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fce89dd-4b21-4cbe-b253-4fdc4405f16b req-3dbbb9ce-a214-4f87-bc14-b3d0a653a135 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:49.197592 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4fce89dd-4b21-4cbe-b253-4fdc4405f16b req-3dbbb9ce-a214-4f87-bc14-b3d0a653a135 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 931 time: 0.0700507 Nov 18 18:21:49.261975 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-a5215d21-4407-4345-bc53-49efe4a89778 None None] Provisioning complete for port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:49.262483 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a5215d21-4407-4345-bc53-49efe4a89778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:49.280040 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4fce89dd-4b21-4cbe-b253-4fdc4405f16b req-7e964488-3e9f-4488-8655-796f25205a05 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0813811 Nov 18 18:21:49.313371 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-a5215d21-4407-4345-bc53-49efe4a89778 None None] Port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:21:49.547908 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b8ded38f-97b4-485b-9845-705c1fb9701d details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:21:49.550128 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 13fa8d72-ea18-463c-9382-23f28f110133 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:49.581573 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e16c03-54c6-4cd3-9d90-29d07aab7aae req-3d4e5aef-9432-4ecd-aa1f-bbfc3404fbc5 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:49.589913 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a9e16c03-54c6-4cd3-9d90-29d07aab7aae req-3d4e5aef-9432-4ecd-aa1f-bbfc3404fbc5 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 945 time: 0.1356308 Nov 18 18:21:49.645083 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d5a1ed38-73b7-489f-8676-f9b3ae9bd34f {{(pid=102688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:21:49.676133 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a9e16c03-54c6-4cd3-9d90-29d07aab7aae req-ba8e0e12-461d-41e9-9a8f-0e50c6fd0494 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753565 Nov 18 18:21:49.676242 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:49.688777 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.provisioning_blocks [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Transition to ACTIVE for port object d5a1ed38-73b7-489f-8676-f9b3ae9bd34f will not be triggered until provisioned by entity L2. {{(pid=102688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:21:49.696600 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:49.804255 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Attempting to bind port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:21:49.804907 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Attempting to bind port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:21:49.805374 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Attempting to bind port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f on network f2a08e65-1c6c-43fe-a019-78643e62bd9f {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:49.812220 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port 13fa8d72-ea18-463c-9382-23f28f110133 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:21:49.813576 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bacb029a-bb2f-4fb7-adc0-0730541c5eab req-df967773-60db-4029-a95a-6f1ea2b78044 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:49.813712 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f on network f2a08e65-1c6c-43fe-a019-78643e62bd9f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:21:49.813983 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Attempting to bind port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f on network f2a08e65-1c6c-43fe-a019-78643e62bd9f {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:21:49.823722 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bacb029a-bb2f-4fb7-adc0-0730541c5eab req-df967773-60db-4029-a95a-6f1ea2b78044 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.1184311 Nov 18 18:21:49.830305 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:21:49.830650 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Checking segment: {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:21:49.831038 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Bound using segment: {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:21:49.831487 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Bound port: d5a1ed38-73b7-489f-8676-f9b3ae9bd34f, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'}}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:21:49.834403 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:49.836104 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 13fa8d72-ea18-463c-9382-23f28f110133 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:49.836868 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:49.838162 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Pushing event updated for resources: {'Port': ['ID=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:49.878912 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b8ded38f-97b4-485b-9845-705c1fb9701d,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:49.899260 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'port_id': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'mac_address': 'fa:16:3e:9b:a4:2d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1342, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:21:49.956601 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bacb029a-bb2f-4fb7-adc0-0730541c5eab req-35aab225-5405-4e8e-8afc-86fe37183543 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1302054 Nov 18 18:21:50.018347 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] For port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f, host hv-cinder-78776, cleared binding levels {{(pid=102688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:21:50.019588 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:50.024225 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] For port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:21:50.036193 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:50.041177 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:50.077573 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b8ded38f-97b4-485b-9845-705c1fb9701d {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:21:50.126593 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b8ded38f-97b4-485b-9845-705c1fb9701d,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:50.128944 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 13fa8d72-ea18-463c-9382-23f28f110133, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=13fa8d72-ea18-463c-9382-23f28f110133,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:50.133434 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:50.142596 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:50.143266 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:50.157132 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] 10.222.0.31 "PUT /v2.0/ports/d5a1ed38-73b7-489f-8676-f9b3ae9bd34f HTTP/1.1" status: 200 len: 1093 time: 1.1526375 Nov 18 18:21:50.157492 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'tag': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:21:50.160042 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-17012d49-9575-446f-a539-8ddb2d1800e6" -d '{"events": [{"name": "network-changed", "server_uuid": "f928d38b-4f6c-47f6-a2e4-70767777e67e", "tag": "d5a1ed38-73b7-489f-8676-f9b3ae9bd34f"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:21:50.173370 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:50.225938 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a0c6a34-20ca-478e-913a-32a47ae5a692 service neutron] Pushing event updated for resources: {'Port': ['ID=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f,revision_number=3']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:50.227717 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=b8ded38f-97b4-485b-9845-705c1fb9701d,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:50.292798 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:21:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-655e2837-664c-4f07-a654-662504d649f8 x-openstack-request-id: req-655e2837-664c-4f07-a654-662504d649f8 {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:21:50.292982 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f928d38b-4f6c-47f6-a2e4-70767777e67e", "tag": "d5a1ed38-73b7-489f-8676-f9b3ae9bd34f", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:21:50.293248 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-655e2837-664c-4f07-a654-662504d649f8 {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:21:50.294014 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'tag': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f', 'status': 'completed', 'code': 200} Nov 18 18:21:50.297988 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a7eefe-0b3d-4f08-81e0-7f10760d47f3 req-3f8817cb-1d1d-4a7f-a4b6-cd0c416237fd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:50.299827 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-91a7eefe-0b3d-4f08-81e0-7f10760d47f3 req-3f8817cb-1d1d-4a7f-a4b6-cd0c416237fd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.1271982 Nov 18 18:21:50.307260 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=13fa8d72-ea18-463c-9382-23f28f110133,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:50.393138 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-6dbd4b66-eb0b-476d-92f0-b9a759ae5dec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:50.394752 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-6dbd4b66-eb0b-476d-92f0-b9a759ae5dec service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1bab99f3344342578dc7b1c29b1ced7e&device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 1096 time: 0.1167495 Nov 18 18:21:50.404842 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-91a7eefe-0b3d-4f08-81e0-7f10760d47f3 req-f7e0c7c9-92ba-4b6c-a9b2-0d44e2a76400 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0881498 Nov 18 18:21:50.461803 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-be74a042-65d1-466f-b4ec-6dc397b4e183 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f HTTP/1.1" status: 200 len: 217 time: 0.0491033 Nov 18 18:21:50.469422 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f429408-faa4-412f-9157-3bd62680d421 req-12228846-162e-417e-92dd-aa3fcb83f53a tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:50.471224 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9f429408-faa4-412f-9157-3bd62680d421 req-12228846-162e-417e-92dd-aa3fcb83f53a tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 943 time: 0.0702319 Nov 18 18:21:50.496181 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f1461fa4-a91b-4537-9c81-67ab32f8d50e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13fa8d72-ea18-463c-9382-23f28f110133'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:21:50.499280 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-45f48b53-d7c5-4d53-b1a9-d0368105a84a" -d '{"events": [{"server_uuid": "f1461fa4-a91b-4537-9c81-67ab32f8d50e", "name": "network-vif-plugged", "status": "completed", "tag": "13fa8d72-ea18-463c-9382-23f28f110133"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:21:50.526427 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['b8ded38f-97b4-485b-9845-705c1fb9701d'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:21:50.554563 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9f429408-faa4-412f-9157-3bd62680d421 req-1414e791-e016-414b-b7d3-3dcadc8d3f8a tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0748463 Nov 18 18:21:50.570525 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-3111c92b-002e-4312-851a-c273bc6f7d54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:50.572486 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-3111c92b-002e-4312-851a-c273bc6f7d54 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=53535ce7-7c2a-450f-87e4-d092908ff080 HTTP/1.1" status: 200 len: 849 time: 0.1029603 Nov 18 18:21:50.590458 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:21:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fa95225a-d661-4830-bd67-75d41d2a919e x-openstack-request-id: req-fa95225a-d661-4830-bd67-75d41d2a919e {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:21:50.590748 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f1461fa4-a91b-4537-9c81-67ab32f8d50e", "name": "network-vif-plugged", "status": "completed", "tag": "13fa8d72-ea18-463c-9382-23f28f110133", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:21:50.591007 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-fa95225a-d661-4830-bd67-75d41d2a919e {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:21:50.592035 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f1461fa4-a91b-4537-9c81-67ab32f8d50e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13fa8d72-ea18-463c-9382-23f28f110133', 'code': 200} Nov 18 18:21:50.669084 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-50aa6af2-23dc-4f2d-9335-bf353028775e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:50.670935 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-50aa6af2-23dc-4f2d-9335-bf353028775e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f2a08e65-1c6c-43fe-a019-78643e62bd9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0831213 Nov 18 18:21:50.791738 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-09608319-8020-4cff-8108-d8372fa475fd service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1019089 Nov 18 18:21:50.813872 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbab571f-658b-43a7-a4d5-c7dd980fee71 req-e55801d7-7ec7-4863-b765-e78a4012faff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:50.815730 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fbab571f-658b-43a7-a4d5-c7dd980fee71 req-e55801d7-7ec7-4863-b765-e78a4012faff service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 1099 time: 0.0422161 Nov 18 18:21:50.876510 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fbab571f-658b-43a7-a4d5-c7dd980fee71 req-448ca53a-41b6-4c87-bfb8-eb5717f640d7 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404377 Nov 18 18:21:50.891809 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-1d2c68c2-c547-424a-b584-14ae32e1088f req-3eff3701-4633-4012-8be0-266f9c0297e7 service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901437 Nov 18 18:21:50.989882 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:51.076035 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d23ee1eb-5fbc-4d0d-9dd2-4ead243ca48d req-065c71a9-4215-4f9d-968a-19bf5db56992 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:51.077630 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d23ee1eb-5fbc-4d0d-9dd2-4ead243ca48d req-065c71a9-4215-4f9d-968a-19bf5db56992 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 944 time: 0.0505335 Nov 18 18:21:51.129787 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d23ee1eb-5fbc-4d0d-9dd2-4ead243ca48d req-38e7cd14-3f87-4af8-a58d-82d55a9303e4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456758 Nov 18 18:21:51.523914 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bbf53e9-a9b6-4d34-9c10-fede7a48400f req-dbf07c3c-c06f-426f-af1d-acc397e0024e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:51.525368 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0bbf53e9-a9b6-4d34-9c10-fede7a48400f req-dbf07c3c-c06f-426f-af1d-acc397e0024e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0455601 Nov 18 18:21:51.573635 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0bbf53e9-a9b6-4d34-9c10-fede7a48400f req-9517442c-684a-49cd-afec-a6dbda9dc2e6 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422635 Nov 18 18:21:51.666225 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5f28b24-177c-42c7-8f55-d6d2c41327b1 req-1572a82b-c96d-417d-8fb6-a75e19f76c2b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:51.667717 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d5f28b24-177c-42c7-8f55-d6d2c41327b1 req-1572a82b-c96d-417d-8fb6-a75e19f76c2b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 943 time: 0.0507433 Nov 18 18:21:51.715654 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d5f28b24-177c-42c7-8f55-d6d2c41327b1 req-e707c113-3725-4c58-889f-30475df623a5 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417461 Nov 18 18:21:52.249794 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28cc3ec8-2b95-4795-8c62-f24a459d44b6 req-e64330a0-b863-453b-b906-b24cb1f72f3d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:52.251654 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-28cc3ec8-2b95-4795-8c62-f24a459d44b6 req-e64330a0-b863-453b-b906-b24cb1f72f3d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 944 time: 0.0506783 Nov 18 18:21:52.299846 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-28cc3ec8-2b95-4795-8c62-f24a459d44b6 req-1683f961-876f-494c-a93d-a4a243b1515d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418026 Nov 18 18:21:52.687065 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fd92ae-0405-4fdc-b00e-04911497262b req-0e8576a0-7158-436c-aa70-83eaaca9a18e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:52.688566 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-89fd92ae-0405-4fdc-b00e-04911497262b req-0e8576a0-7158-436c-aa70-83eaaca9a18e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0497663 Nov 18 18:21:52.733523 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-89fd92ae-0405-4fdc-b00e-04911497262b req-f146673a-6c3f-4909-a906-5e32d726669c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385883 Nov 18 18:21:52.831699 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a7838e3-2433-48fb-b2fb-d461cba3fd18 req-e1ae6b72-5d31-486b-9d00-b2c6e0e6674e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:52.833170 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a7838e3-2433-48fb-b2fb-d461cba3fd18 req-e1ae6b72-5d31-486b-9d00-b2c6e0e6674e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 943 time: 0.0470390 Nov 18 18:21:52.878749 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a7838e3-2433-48fb-b2fb-d461cba3fd18 req-8e4fc14d-dc45-44a8-8422-cd681937d1e4 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393646 Nov 18 18:21:53.415590 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66cc3fbd-0a3f-4af5-8a22-4bb8c558b9b1 req-4a7e6255-f038-4117-9813-446db69df997 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:53.417388 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-66cc3fbd-0a3f-4af5-8a22-4bb8c558b9b1 req-4a7e6255-f038-4117-9813-446db69df997 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 944 time: 0.0468192 Nov 18 18:21:53.465788 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-66cc3fbd-0a3f-4af5-8a22-4bb8c558b9b1 req-9c88fac1-096b-46b4-b6ea-465ef87def08 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427520 Nov 18 18:21:53.843265 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f51cf15-fce8-44be-9813-8d3124b41a32 req-f1492c8f-ac3c-4c85-ab22-80b6b874c2e0 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:53.844810 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1f51cf15-fce8-44be-9813-8d3124b41a32 req-f1492c8f-ac3c-4c85-ab22-80b6b874c2e0 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0472605 Nov 18 18:21:53.896632 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1f51cf15-fce8-44be-9813-8d3124b41a32 req-a5a0735d-7556-4ff2-b3e6-05b28f861051 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445082 Nov 18 18:21:53.997468 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1547050-6c3d-4eb3-a3fe-0a4f20fc7aee req-fa735111-0726-4990-87b0-1cb406fee09b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:53.998933 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d1547050-6c3d-4eb3-a3fe-0a4f20fc7aee req-fa735111-0726-4990-87b0-1cb406fee09b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 943 time: 0.0483267 Nov 18 18:21:54.045883 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d1547050-6c3d-4eb3-a3fe-0a4f20fc7aee req-94bf3410-71e8-4974-9adb-5c47ae65c46d tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410652 Nov 18 18:21:54.249300 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17012d49-9575-446f-a539-8ddb2d1800e6 req-365576b1-58a3-458f-902f-9ebacb02f555 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:54.250802 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-17012d49-9575-446f-a539-8ddb2d1800e6 req-365576b1-58a3-458f-902f-9ebacb02f555 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1bab99f3344342578dc7b1c29b1ced7e&device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 1096 time: 0.0413935 Nov 18 18:21:54.374022 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17012d49-9575-446f-a539-8ddb2d1800e6 req-688a8582-6ae1-4c58-8cc3-2db8d179ab01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:54.376531 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-17012d49-9575-446f-a539-8ddb2d1800e6 req-688a8582-6ae1-4c58-8cc3-2db8d179ab01 service neutron] 10.222.0.31 "GET /v2.0/networks?id=f2a08e65-1c6c-43fe-a019-78643e62bd9f HTTP/1.1" status: 200 len: 912 time: 0.1020467 Nov 18 18:21:54.434260 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-17012d49-9575-446f-a539-8ddb2d1800e6 req-d203708f-7ebe-4871-b95a-cdb497aa8d12 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f HTTP/1.1" status: 200 len: 217 time: 0.0357990 Nov 18 18:21:54.491045 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17012d49-9575-446f-a539-8ddb2d1800e6 req-9cfeee62-8053-49d9-a344-8668fe1f1b33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:54.492514 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-17012d49-9575-446f-a539-8ddb2d1800e6 req-9cfeee62-8053-49d9-a344-8668fe1f1b33 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=53535ce7-7c2a-450f-87e4-d092908ff080 HTTP/1.1" status: 200 len: 849 time: 0.0437820 Nov 18 18:21:54.543842 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17012d49-9575-446f-a539-8ddb2d1800e6 req-6dad2da0-2dff-4bc1-8128-ad04f01dc139 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:54.545347 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-17012d49-9575-446f-a539-8ddb2d1800e6 req-6dad2da0-2dff-4bc1-8128-ad04f01dc139 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f2a08e65-1c6c-43fe-a019-78643e62bd9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0409167 Nov 18 18:21:54.588996 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b560edc-37a7-4cd3-9757-bb6b45d86b62 req-7dfce98f-01db-4ed2-884c-5edda513683e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:54.590615 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0b560edc-37a7-4cd3-9757-bb6b45d86b62 req-7dfce98f-01db-4ed2-884c-5edda513683e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 944 time: 0.0519660 Nov 18 18:21:54.638023 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0b560edc-37a7-4cd3-9757-bb6b45d86b62 req-aee990b1-e8bf-4e97-9927-b69a95ef32f9 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411203 Nov 18 18:21:54.651819 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-17012d49-9575-446f-a539-8ddb2d1800e6 req-644b6e23-11d9-4895-ae1e-07cf48c14c9c service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907404 Nov 18 18:21:54.753531 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-17012d49-9575-446f-a539-8ddb2d1800e6 req-bb18dcd1-cc83-4269-8e40-4432f52eb9af service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854287 Nov 18 18:21:55.009746 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07aa0d90-ca68-4db5-84b7-2b94c1df3f08 req-3f4a3099-6999-4e6b-8e5e-6ec43cce3dd5 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:55.011136 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-07aa0d90-ca68-4db5-84b7-2b94c1df3f08 req-3f4a3099-6999-4e6b-8e5e-6ec43cce3dd5 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0464535 Nov 18 18:21:55.056939 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-07aa0d90-ca68-4db5-84b7-2b94c1df3f08 req-c8bcaa32-12b7-4880-8b3e-96aea9130912 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399935 Nov 18 18:21:55.158770 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58762c5e-e3dc-4cb1-b7d3-173cddd0e37d req-4cc10e9e-6a30-46c2-80d2-1828c72a8fcc tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:55.160218 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58762c5e-e3dc-4cb1-b7d3-173cddd0e37d req-4cc10e9e-6a30-46c2-80d2-1828c72a8fcc tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 943 time: 0.0494692 Nov 18 18:21:55.204346 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58762c5e-e3dc-4cb1-b7d3-173cddd0e37d req-95f5c64d-f7c5-4e19-81ce-9690bb5ec552 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383635 Nov 18 18:21:55.767046 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9316917-3d04-4f36-90e2-b7124140718f req-43c0d6fa-b81b-4344-b78e-243b4a40e6d7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:55.768686 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b9316917-3d04-4f36-90e2-b7124140718f req-43c0d6fa-b81b-4344-b78e-243b4a40e6d7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 944 time: 0.0532286 Nov 18 18:21:55.828482 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b9316917-3d04-4f36-90e2-b7124140718f req-7a330b1b-b47f-4cee-970b-2760f3a8a4db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0526872 Nov 18 18:21:55.838095 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 36588) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:55.949074 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3967492e-1f8c-415d-bff7-33c37cce2d10 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.020163 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3967492e-1f8c-415d-bff7-33c37cce2d10 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.023713 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3967492e-1f8c-415d-bff7-33c37cce2d10 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.063638 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-3967492e-1f8c-415d-bff7-33c37cce2d10 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f0af3ea9537649f79a4f36f399a4249f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2242393 Nov 18 18:21:56.064497 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3967492e-1f8c-415d-bff7-33c37cce2d10 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b4a4403-d8da-4260-a703-5554712d93c8,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:56.066439 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36596) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:56.117481 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-be070ecf-38e6-43fe-9abc-007cc21a98f7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.140384 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-be070ecf-38e6-43fe-9abc-007cc21a98f7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.175194 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-593e23e0-3ef1-48cb-b846-14c4c25ecb97 req-976080d3-556f-422e-819b-4f31de9b63a7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:56.176860 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-593e23e0-3ef1-48cb-b846-14c4c25ecb97 req-976080d3-556f-422e-819b-4f31de9b63a7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0544326 Nov 18 18:21:56.192539 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-be070ecf-38e6-43fe-9abc-007cc21a98f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.195112 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-be070ecf-38e6-43fe-9abc-007cc21a98f7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.196709 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-be070ecf-38e6-43fe-9abc-007cc21a98f7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1b4a4403-d8da-4260-a703-5554712d93c8 HTTP/1.1" status: 204 len: 168 time: 0.1283801 Nov 18 18:21:56.204114 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be070ecf-38e6-43fe-9abc-007cc21a98f7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b4a4403-d8da-4260-a703-5554712d93c8,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:56.233255 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-593e23e0-3ef1-48cb-b846-14c4c25ecb97 req-569641a1-26b3-40fe-a779-389b64ce27fe tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495925 Nov 18 18:21:56.320894 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7793a0-5c64-4647-b9d9-6df948347967 req-84baa94c-cf7c-47d1-9bc2-b399186b0729 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:56.322377 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9a7793a0-5c64-4647-b9d9-6df948347967 req-84baa94c-cf7c-47d1-9bc2-b399186b0729 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 943 time: 0.0469680 Nov 18 18:21:56.369360 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9a7793a0-5c64-4647-b9d9-6df948347967 req-a8b1ab7d-c6f2-481d-8ed5-b332d8e8368a tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407887 Nov 18 18:21:56.458455 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36606) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:56.462114 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b8ded38f-97b4-485b-9845-705c1fb9701d up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:21:56.472938 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3c72b4f4-43f7-4f9f-933c-3977d1988df9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.523916 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port b8ded38f-97b4-485b-9845-705c1fb9701d completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:21:56.529134 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port b8ded38f-97b4-485b-9845-705c1fb9701d triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:21:56.529689 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.564964 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3c72b4f4-43f7-4f9f-933c-3977d1988df9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.570884 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3c72b4f4-43f7-4f9f-933c-3977d1988df9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.616079 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-3c72b4f4-43f7-4f9f-933c-3977d1988df9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7b66d9dd365549d6b00cd85e4ed2c915&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1532319 Nov 18 18:21:56.616079 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c72b4f4-43f7-4f9f-933c-3977d1988df9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df7577f4-fcc6-482d-8221-0729b8ce8013,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:56.616485 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.617467 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 36614) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:56.640363 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:21:56.642817 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dcb7a4d1-06a1-4e9b-a9a5-346974ee4559" -d '{"events": [{"server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "name": "network-vif-plugged", "status": "completed", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:21:56.659470 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b8ded38f-97b4-485b-9845-705c1fb9701d,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:56.669653 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.687846 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-00c57ae4-158f-4395-b20c-ff0c998d6a84 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.702563 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:21:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-79334e9f-6d2b-4ab1-afcf-6d6c9c6a75ab x-openstack-request-id: req-79334e9f-6d2b-4ab1-afcf-6d6c9c6a75ab {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:21:56.702888 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "name": "network-vif-plugged", "status": "completed", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:21:56.703378 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-79334e9f-6d2b-4ab1-afcf-6d6c9c6a75ab {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:21:56.703921 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'code': 200} Nov 18 18:21:56.711453 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-00c57ae4-158f-4395-b20c-ff0c998d6a84 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.731877 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=b8ded38f-97b4-485b-9845-705c1fb9701d,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:56.760405 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-00c57ae4-158f-4395-b20c-ff0c998d6a84 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.762968 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-00c57ae4-158f-4395-b20c-ff0c998d6a84 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:56.764530 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-00c57ae4-158f-4395-b20c-ff0c998d6a84 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/df7577f4-fcc6-482d-8221-0729b8ce8013 HTTP/1.1" status: 204 len: 168 time: 0.1451283 Nov 18 18:21:56.771663 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00c57ae4-158f-4395-b20c-ff0c998d6a84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df7577f4-fcc6-482d-8221-0729b8ce8013,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:56.957340 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9262ed-09ed-4268-bd1f-ede8102296f0 req-2ae90913-17dd-4091-b084-666ec66bb4c6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:56.958833 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-cf9262ed-09ed-4268-bd1f-ede8102296f0 req-2ae90913-17dd-4091-b084-666ec66bb4c6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0528114 Nov 18 18:21:57.015388 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-cf9262ed-09ed-4268-bd1f-ede8102296f0 req-2616a84f-109f-4aee-adc7-3a69b8e6e102 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475674 Nov 18 18:21:57.347591 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a0e7d56-66f9-4d43-9800-bdd542ee4a8d req-96881d94-9128-46a7-8c0c-94faf6c17103 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:57.349303 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a0e7d56-66f9-4d43-9800-bdd542ee4a8d req-96881d94-9128-46a7-8c0c-94faf6c17103 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0476544 Nov 18 18:21:57.404613 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a0e7d56-66f9-4d43-9800-bdd542ee4a8d req-510ecdff-b806-4995-90c8-7b417d83599d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491021 Nov 18 18:21:57.485366 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8574dfd8-a810-4de6-8a82-2376521544cf req-bf98ce12-7b91-4d88-9573-39142eec008c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:57.486855 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8574dfd8-a810-4de6-8a82-2376521544cf req-bf98ce12-7b91-4d88-9573-39142eec008c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 943 time: 0.0476968 Nov 18 18:21:57.536270 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8574dfd8-a810-4de6-8a82-2376521544cf req-6867558a-e306-4049-8022-1a78e3d20d8b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426331 Nov 18 18:21:58.145062 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63c52a49-5aab-4542-8653-2debdf0493a9 req-7282c4c4-c4e4-441a-b498-6ad528d1219b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:58.146667 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-63c52a49-5aab-4542-8653-2debdf0493a9 req-7282c4c4-c4e4-441a-b498-6ad528d1219b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0500934 Nov 18 18:21:58.194510 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-63c52a49-5aab-4542-8653-2debdf0493a9 req-f5fa8a90-3db9-4af4-afd0-fe02593f0679 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412879 Nov 18 18:21:58.522249 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88dc102e-99a7-48c6-9b54-5a7b82f5ec47 req-a5a84991-cc6d-45e4-92b1-16b63439cfd2 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:58.523722 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88dc102e-99a7-48c6-9b54-5a7b82f5ec47 req-a5a84991-cc6d-45e4-92b1-16b63439cfd2 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0504313 Nov 18 18:21:58.572882 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88dc102e-99a7-48c6-9b54-5a7b82f5ec47 req-d2537a01-6e9f-4dff-81f5-356ffbbdc956 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431778 Nov 18 18:21:58.668719 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb4d43f3-cd34-4a95-81d2-ae237125d648 req-614b5cf8-083f-4229-8db8-198bbe02ebe3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:58.670817 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eb4d43f3-cd34-4a95-81d2-ae237125d648 req-614b5cf8-083f-4229-8db8-198bbe02ebe3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 943 time: 0.0650623 Nov 18 18:21:58.696745 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36722) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:58.729137 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eb4d43f3-cd34-4a95-81d2-ae237125d648 req-7e38c713-5bff-4888-8255-b0fc4f106f73 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517008 Nov 18 18:21:58.816163 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34722991-302d-48b9-8929-e4a9f5317f1c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:58.899247 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e62e6b-410b-4411-a74e-dcd34c449168 req-d713af38-91e3-4d12-8aa4-6e270683ce62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:58.900946 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-09e62e6b-410b-4411-a74e-dcd34c449168 req-d713af38-91e3-4d12-8aa4-6e270683ce62 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 1098 time: 0.0609226 Nov 18 18:21:58.935663 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34722991-302d-48b9-8929-e4a9f5317f1c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:58.945219 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34722991-302d-48b9-8929-e4a9f5317f1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:58.997342 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-09e62e6b-410b-4411-a74e-dcd34c449168 req-f34f1a94-9f5a-4cc7-b5ce-778538ec2a58 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0861800 Nov 18 18:21:59.003995 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-34722991-302d-48b9-8929-e4a9f5317f1c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f720d88017624274b1e20c6157a02085&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3061757 Nov 18 18:21:59.004925 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34722991-302d-48b9-8929-e4a9f5317f1c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e10a400f-a3c1-48c4-9d22-a43713cc7ecb,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:59.006769 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 36730) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:59.063466 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-09d0c205-6b4b-4712-adf8-25c0eb4cb929 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:59.083912 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-09d0c205-6b4b-4712-adf8-25c0eb4cb929 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:59.134369 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-09d0c205-6b4b-4712-adf8-25c0eb4cb929 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:59.137021 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-09d0c205-6b4b-4712-adf8-25c0eb4cb929 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:59.138156 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-09d0c205-6b4b-4712-adf8-25c0eb4cb929 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e10a400f-a3c1-48c4-9d22-a43713cc7ecb HTTP/1.1" status: 204 len: 168 time: 0.1301103 Nov 18 18:21:59.146093 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09d0c205-6b4b-4712-adf8-25c0eb4cb929 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e10a400f-a3c1-48c4-9d22-a43713cc7ecb,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:59.317002 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d7e277b-c108-4958-9cb5-e18479a80366 req-0b7e680f-ebeb-44f5-bed6-5be64a168ee2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:59.318559 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5d7e277b-c108-4958-9cb5-e18479a80366 req-0b7e680f-ebeb-44f5-bed6-5be64a168ee2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0484982 Nov 18 18:21:59.368117 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5d7e277b-c108-4958-9cb5-e18479a80366 req-0ba82cf2-7a5c-4b49-9783-9d48b4a97da9 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430181 Nov 18 18:21:59.402574 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 36740) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:59.416398 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-46e21839-b1fa-45b0-8c0f-74ab79b4fd54 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:59.480740 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:21:59.489695 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-46e21839-b1fa-45b0-8c0f-74ab79b4fd54 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:59.493805 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-46e21839-b1fa-45b0-8c0f-74ab79b4fd54 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:59.530903 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-46e21839-b1fa-45b0-8c0f-74ab79b4fd54 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=132ef3c0af924384941598c844cc41db&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1272616 Nov 18 18:21:59.531741 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46e21839-b1fa-45b0-8c0f-74ab79b4fd54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20fcaff7-68e1-4582-bd85-2d0916ee189f,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:59.533732 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36742) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:21:59.583836 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-20c050df-2982-427e-b671-6158991f9468 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:59.604930 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-20c050df-2982-427e-b671-6158991f9468 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:59.652176 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-20c050df-2982-427e-b671-6158991f9468 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:59.654964 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-20c050df-2982-427e-b671-6158991f9468 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:21:59.656141 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-20c050df-2982-427e-b671-6158991f9468 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/20fcaff7-68e1-4582-bd85-2d0916ee189f HTTP/1.1" status: 204 len: 168 time: 0.1213186 Nov 18 18:21:59.665112 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20c050df-2982-427e-b671-6158991f9468 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=20fcaff7-68e1-4582-bd85-2d0916ee189f,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:21:59.699178 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf12c02-4940-4ede-96b2-52eabb640b88 req-9a0be62b-53b8-47b6-ad41-c0df1dfc5d49 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:59.700859 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4bf12c02-4940-4ede-96b2-52eabb640b88 req-9a0be62b-53b8-47b6-ad41-c0df1dfc5d49 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0599022 Nov 18 18:21:59.761708 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4bf12c02-4940-4ede-96b2-52eabb640b88 req-a8e5caf4-ef14-4414-8531-245a27df2ec0 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474944 Nov 18 18:21:59.867169 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device d5a1ed38-73b7-489f-8676-f9b3ae9bd34f details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:21:59.870831 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84cd5d89-aa7f-4665-84de-64b0ecaa8e8d req-868914bb-5afb-4b28-a2eb-614cce98711c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:21:59.872140 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-84cd5d89-aa7f-4665-84de-64b0ecaa8e8d req-868914bb-5afb-4b28-a2eb-614cce98711c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 943 time: 0.0558448 Nov 18 18:21:59.929258 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-84cd5d89-aa7f-4665-84de-64b0ecaa8e8d req-6095b5bc-b475-430e-88bd-fa9e4220d11d tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0510635 Nov 18 18:21:59.981235 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:21:59.994480 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'port_id': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f', 'mac_address': 'fa:16:3e:c5:2a:b8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1348, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:22:00.052093 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:00.082997 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d5a1ed38-73b7-489f-8676-f9b3ae9bd34f {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:22:00.138757 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:22:00.148040 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:00.201669 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4808c480-2ad3-409d-b27e-6a07e55a852e req-bace343b-83b9-46be-89ff-0d0b9d540a75 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:00.204351 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d218fe-d9d8-4063-a78c-cfc0c44dad90 req-0531b78d-86b9-4ba9-917c-79fbf700ed10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:00.205243 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4808c480-2ad3-409d-b27e-6a07e55a852e req-bace343b-83b9-46be-89ff-0d0b9d540a75 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0738201 Nov 18 18:22:00.211471 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-f1d218fe-d9d8-4063-a78c-cfc0c44dad90 req-0531b78d-86b9-4ba9-917c-79fbf700ed10 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 1099 time: 0.0949559 Nov 18 18:22:00.285103 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4808c480-2ad3-409d-b27e-6a07e55a852e req-7f731a52-ce10-4ac6-9266-dd119bfc4f9d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0716040 Nov 18 18:22:00.288089 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:00.334942 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d218fe-d9d8-4063-a78c-cfc0c44dad90 req-1201a709-d14c-43a3-b743-edfdd838b9c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:00.337294 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-f1d218fe-d9d8-4063-a78c-cfc0c44dad90 req-1201a709-d14c-43a3-b743-edfdd838b9c7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 921 time: 0.1149907 Nov 18 18:22:00.384561 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-f1d218fe-d9d8-4063-a78c-cfc0c44dad90 req-11ab58ea-7ecb-4d94-ae17-83431e5f91ba service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=13fa8d72-ea18-463c-9382-23f28f110133 HTTP/1.1" status: 200 len: 217 time: 0.0359318 Nov 18 18:22:00.441423 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d218fe-d9d8-4063-a78c-cfc0c44dad90 req-a53a7f4f-c471-4811-a455-e0d22c9ac9bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:00.442916 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-f1d218fe-d9d8-4063-a78c-cfc0c44dad90 req-a53a7f4f-c471-4811-a455-e0d22c9ac9bd service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 HTTP/1.1" status: 200 len: 859 time: 0.0489926 Nov 18 18:22:00.484136 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-f1d218fe-d9d8-4063-a78c-cfc0c44dad90 req-d05bbbd7-9c37-49ce-b9f9-c0c6fb35205b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0293524 Nov 18 18:22:00.516719 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e9f7a7e-bb6e-4477-876c-3da98ff2b8ee req-03bcd78d-d604-4bd6-a346-850e5bcec14e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:00.516719 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0e9f7a7e-bb6e-4477-876c-3da98ff2b8ee req-03bcd78d-d604-4bd6-a346-850e5bcec14e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0587857 Nov 18 18:22:00.589579 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0e9f7a7e-bb6e-4477-876c-3da98ff2b8ee req-832f31f2-2b2d-469b-ad55-750127ff7f96 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0685110 Nov 18 18:22:00.625258 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-f1d218fe-d9d8-4063-a78c-cfc0c44dad90 req-ff0c1de8-d5d5-48df-b793-968b617da355 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1099191 Nov 18 18:22:00.735054 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-f1d218fe-d9d8-4063-a78c-cfc0c44dad90 req-c90fa83c-5b1a-4e24-8e61-dbc682926d48 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1016860 Nov 18 18:22:00.834918 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['d5a1ed38-73b7-489f-8676-f9b3ae9bd34f'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:22:00.948661 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 36810) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:01.096730 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee078b0a-9d2b-4168-8d57-4a99687e2e27 req-dca0ecee-44d6-4416-ad37-e0b1647a72c8 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:01.098218 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ee078b0a-9d2b-4168-8d57-4a99687e2e27 req-dca0ecee-44d6-4416-ad37-e0b1647a72c8 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 944 time: 0.0641098 Nov 18 18:22:01.104961 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e87e98d5-d95b-4872-a641-a7a01b31be7e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:01.178796 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ee078b0a-9d2b-4168-8d57-4a99687e2e27 req-5dbae5c8-aa37-40a4-875e-f0cdfa11c3e9 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0710680 Nov 18 18:22:01.223061 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e87e98d5-d95b-4872-a641-a7a01b31be7e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:01.228695 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e87e98d5-d95b-4872-a641-a7a01b31be7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:01.264652 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e87e98d5-d95b-4872-a641-a7a01b31be7e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cee0fbe8-f1ff-49ba-b9b4-b6c0e112ab3a,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:01.270781 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-e87e98d5-d95b-4872-a641-a7a01b31be7e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b7679fd1a933446ab1a037e08e90e94d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3210113 Nov 18 18:22:01.273633 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36826) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:01.329655 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bccec3ca-fa12-46ae-8b48-65465cb34813 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:01.354558 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bccec3ca-fa12-46ae-8b48-65465cb34813 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:01.428773 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bccec3ca-fa12-46ae-8b48-65465cb34813 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:01.431174 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bccec3ca-fa12-46ae-8b48-65465cb34813 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:01.432921 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-bccec3ca-fa12-46ae-8b48-65465cb34813 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cee0fbe8-f1ff-49ba-b9b4-b6c0e112ab3a HTTP/1.1" status: 204 len: 168 time: 0.1572134 Nov 18 18:22:01.441932 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bccec3ca-fa12-46ae-8b48-65465cb34813 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cee0fbe8-f1ff-49ba-b9b4-b6c0e112ab3a,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:01.471897 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74804f8b-f7e5-49a4-92b5-71b35ce1c8d9 req-4ff117ac-0f3f-4f1e-80de-de2adb2fb1e3 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:01.479424 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-74804f8b-f7e5-49a4-92b5-71b35ce1c8d9 req-4ff117ac-0f3f-4f1e-80de-de2adb2fb1e3 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0852439 Nov 18 18:22:01.534382 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-74804f8b-f7e5-49a4-92b5-71b35ce1c8d9 req-4939e9d3-21ba-4a0c-ae28-cc0524d7fa90 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475702 Nov 18 18:22:01.736640 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea61d07-30ab-4fb3-a6a3-18303971474d req-526ce3fd-0718-4b2a-8ae1-9958e8a19dee tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:01.738167 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2ea61d07-30ab-4fb3-a6a3-18303971474d req-526ce3fd-0718-4b2a-8ae1-9958e8a19dee tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0581536 Nov 18 18:22:01.791396 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2ea61d07-30ab-4fb3-a6a3-18303971474d req-a16e3c13-6222-476e-8756-6ba312d38499 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472116 Nov 18 18:22:01.880648 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36856) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:01.894211 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6279f91b-1fb4-4150-aece-346c7fa20809 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:01.928631 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f952d21-d2bc-4500-b2c3-92f01768f6fa req-80ed27dd-d6f9-4d82-b42d-6bb55b1c13e2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:01.931231 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3f952d21-d2bc-4500-b2c3-92f01768f6fa req-80ed27dd-d6f9-4d82-b42d-6bb55b1c13e2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0609522 Nov 18 18:22:01.941383 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 36858) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:01.946786 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-36144fbf-be7a-4968-9a3e-7abb009269af tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Request body: {'floatingip': {'port_id': 'b8ded38f-97b4-485b-9845-705c1fb9701d'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:22:01.987210 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6279f91b-1fb4-4150-aece-346c7fa20809 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:01.997510 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6279f91b-1fb4-4150-aece-346c7fa20809 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.048166 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-6279f91b-1fb4-4150-aece-346c7fa20809 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e514caf1ff8e4f258090f599839ff0cf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1658032 Nov 18 18:22:02.049487 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6279f91b-1fb4-4150-aece-346c7fa20809 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d55a1f4f-faa2-4588-b45e-2643399e2f46,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:02.062768 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36864) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:02.121611 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ed0013ad-6194-4de6-85f1-d74d3045cb5b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.156091 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ed0013ad-6194-4de6-85f1-d74d3045cb5b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.204571 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-36144fbf-be7a-4968-9a3e-7abb009269af tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.227315 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ed0013ad-6194-4de6-85f1-d74d3045cb5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.231013 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ed0013ad-6194-4de6-85f1-d74d3045cb5b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.232663 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-ed0013ad-6194-4de6-85f1-d74d3045cb5b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d55a1f4f-faa2-4588-b45e-2643399e2f46 HTTP/1.1" status: 204 len: 168 time: 0.1683204 Nov 18 18:22:02.244550 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0013ad-6194-4de6-85f1-d74d3045cb5b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d55a1f4f-faa2-4588-b45e-2643399e2f46,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:02.421268 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7c4651c-3fb2-490b-9370-1248a5539e29 req-6e035730-0e72-4272-ba44-4539125c832d tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:02.423571 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f7c4651c-3fb2-490b-9370-1248a5539e29 req-6e035730-0e72-4272-ba44-4539125c832d tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 944 time: 0.1338611 Nov 18 18:22:02.554245 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f7c4651c-3fb2-490b-9370-1248a5539e29 req-172ba49e-e29f-4688-b1b9-d08f4b07bb39 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0904257 Nov 18 18:22:02.707647 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36886) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:02.721172 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a7062140-c688-402d-a97f-304d2cf26cb6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.799244 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a7062140-c688-402d-a97f-304d2cf26cb6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.803703 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a7062140-c688-402d-a97f-304d2cf26cb6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.840639 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a7062140-c688-402d-a97f-304d2cf26cb6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=472750fecef140c39319d7ff1d07e03a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1318359 Nov 18 18:22:02.841732 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7062140-c688-402d-a97f-304d2cf26cb6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=58fd4bc5-ff03-4c92-b554-5ccab7c6f9c2,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:02.844474 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 36888) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:02.852146 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b01b9d6-dfcb-4e3d-ae9b-aa309729e542 req-3c633e3e-3917-48dc-a744-34fa33c1e73f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:02.853653 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6b01b9d6-dfcb-4e3d-ae9b-aa309729e542 req-3c633e3e-3917-48dc-a744-34fa33c1e73f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.1888783 Nov 18 18:22:02.892134 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-98c0247b-c68d-4928-bafd-9dba9b33c391 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.916240 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-98c0247b-c68d-4928-bafd-9dba9b33c391 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.957361 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b9c2ad-8d19-4c47-8608-5cceaba119a7 req-bb2b9176-9345-4553-ba52-cb35c6f82f75 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:02.958995 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-57b9c2ad-8d19-4c47-8608-5cceaba119a7 req-bb2b9176-9345-4553-ba52-cb35c6f82f75 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 945 time: 0.2004368 Nov 18 18:22:02.967741 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-98c0247b-c68d-4928-bafd-9dba9b33c391 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.970462 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-98c0247b-c68d-4928-bafd-9dba9b33c391 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:02.971595 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-98c0247b-c68d-4928-bafd-9dba9b33c391 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/58fd4bc5-ff03-4c92-b554-5ccab7c6f9c2 HTTP/1.1" status: 204 len: 168 time: 0.1267350 Nov 18 18:22:02.980285 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98c0247b-c68d-4928-bafd-9dba9b33c391 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58fd4bc5-ff03-4c92-b554-5ccab7c6f9c2,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:03.008423 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.db.resource_extend [None req-36144fbf-be7a-4968-9a3e-7abb009269af tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 18 18:22:03.061442 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6b01b9d6-dfcb-4e3d-ae9b-aa309729e542 req-343aaba4-1678-40d0-a45a-225bf8497029 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1910880 Nov 18 18:22:03.111738 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-57b9c2ad-8d19-4c47-8608-5cceaba119a7 req-8872efe5-da5c-47a2-9247-3f4776f5c2e9 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1439996 Nov 18 18:22:03.116180 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-36144fbf-be7a-4968-9a3e-7abb009269af tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:03.120212 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-36144fbf-be7a-4968-9a3e-7abb009269af tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:03.223144 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [None req-36144fbf-be7a-4968-9a3e-7abb009269af tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Floating IP 64c90213-fc61-4b3c-9477-dae011bc2072 associated. External IP: 172.27.1.229, port: b8ded38f-97b4-485b-9845-705c1fb9701d. Nov 18 18:22:03.448805 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-36144fbf-be7a-4968-9a3e-7abb009269af tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Router 5f928fdc-791e-4821-b088-039c140695e9 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:22:03.805314 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36144fbf-be7a-4968-9a3e-7abb009269af tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:22:03.814177 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-36144fbf-be7a-4968-9a3e-7abb009269af tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:03.821647 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a3aef12-1a22-40c5-86cb-120dff8054c7 None None] Sync routers for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:22:03.834036 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a3aef12-1a22-40c5-86cb-120dff8054c7 None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:22:03.835078 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-0a3aef12-1a22-40c5-86cb-120dff8054c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:22:03.864859 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-36144fbf-be7a-4968-9a3e-7abb009269af tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "PUT /v2.0/floatingips/64c90213-fc61-4b3c-9477-dae011bc2072 HTTP/1.1" status: 200 len: 991 time: 1.9177630 Nov 18 18:22:03.876511 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a6313d-a736-48e2-968f-d59f3549aa38 req-42955516-ea21-45a4-9a58-9c28c87d1ca5 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:03.878878 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e8a6313d-a736-48e2-968f-d59f3549aa38 req-42955516-ea21-45a4-9a58-9c28c87d1ca5 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 944 time: 0.1229045 Nov 18 18:22:03.879391 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:22:03.887221 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd904caa-e444-4e84-a96e-148047731968" -d '{"events": [{"name": "network-changed", "server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:22:03.892550 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device d5a1ed38-73b7-489f-8676-f9b3ae9bd34f up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:22:03.961361 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:22:03.974950 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:22:03.975579 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:03.979193 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-0a3aef12-1a22-40c5-86cb-120dff8054c7 None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:22:04.008500 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e8a6313d-a736-48e2-968f-d59f3549aa38 req-1a1bf6d4-4b62-4ac9-805e-735f3b796208 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0889950 Nov 18 18:22:04.014582 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bbded826-9781-456d-b807-720a3c015bc9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:04.063852 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:22:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ffe8a593-b1b3-48e0-8d42-d49b15caa61a x-openstack-request-id: req-ffe8a593-b1b3-48e0-8d42-d49b15caa61a {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:22:04.064180 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:22:04.064441 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-ffe8a593-b1b3-48e0-8d42-d49b15caa61a {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:22:04.064882 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'status': 'completed', 'code': 200} Nov 18 18:22:04.096341 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:04.127060 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:22:04.129628 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2883b04d-fdfa-4846-984c-7ceed60007cd" -d '{"events": [{"server_uuid": "f928d38b-4f6c-47f6-a2e4-70767777e67e", "name": "network-vif-plugged", "status": "completed", "tag": "d5a1ed38-73b7-489f-8676-f9b3ae9bd34f"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:22:04.152759 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:22:04.158948 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:04.212210 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd904caa-e444-4e84-a96e-148047731968 req-aaeb4342-5baa-4798-8ad1-339e6d58517f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:04.215834 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-dd904caa-e444-4e84-a96e-148047731968 req-aaeb4342-5baa-4798-8ad1-339e6d58517f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 1098 time: 0.0813534 Nov 18 18:22:04.243378 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:04.276007 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-299da374-e191-470f-9ff4-86b73908d355 req-1369ef14-32d5-4000-a85c-7f759289ca52 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:04.277801 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-299da374-e191-470f-9ff4-86b73908d355 req-1369ef14-32d5-4000-a85c-7f759289ca52 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0847754 Nov 18 18:22:04.311551 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcb63f76-6c61-4f04-9f9c-2602f82308eb req-2239cd0e-5755-4202-9f4c-71917267aa51 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:04.313138 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bcb63f76-6c61-4f04-9f9c-2602f82308eb req-2239cd0e-5755-4202-9f4c-71917267aa51 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 945 time: 0.0813253 Nov 18 18:22:04.347974 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-0a3aef12-1a22-40c5-86cb-120dff8054c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '64c90213-fc61-4b3c-9477-dae011bc2072', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'floating_ip_address': '172.27.1.229', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '5f928fdc-791e-4821-b088-039c140695e9', 'port_id': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 111, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'mac_address': 'fa:16:3e:9b:a4:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:21:29Z', 'updated_at': '2021-11-18T18:22:02Z', 'revision_number': 1, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:24Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:22:04.356823 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-299da374-e191-470f-9ff4-86b73908d355 req-678415c7-c881-4f53-889d-375677253757 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709243 Nov 18 18:22:04.380761 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a3aef12-1a22-40c5-86cb-120dff8054c7 None None] Checking router: 5f928fdc-791e-4821-b088-039c140695e9 for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:22:04.391013 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a3aef12-1a22-40c5-86cb-120dff8054c7 None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:22:04.391653 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-0a3aef12-1a22-40c5-86cb-120dff8054c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:21:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:22:04.397837 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bcb63f76-6c61-4f04-9f9c-2602f82308eb req-1823d7ef-0b7d-4915-875c-ea6ca4fda489 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738201 Nov 18 18:22:04.416277 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:22:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5d6feab-11f9-425a-b1a8-aded70bed89a x-openstack-request-id: req-c5d6feab-11f9-425a-b1a8-aded70bed89a {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:22:04.416626 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f928d38b-4f6c-47f6-a2e4-70767777e67e", "name": "network-vif-plugged", "status": "completed", "tag": "d5a1ed38-73b7-489f-8676-f9b3ae9bd34f", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:22:04.417088 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-c5d6feab-11f9-425a-b1a8-aded70bed89a {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:22:04.417531 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f', 'code': 200} Nov 18 18:22:04.509631 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-0a3aef12-1a22-40c5-86cb-120dff8054c7 None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:22:04.735363 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-0a3aef12-1a22-40c5-86cb-120dff8054c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '64c90213-fc61-4b3c-9477-dae011bc2072', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'floating_ip_address': '172.27.1.229', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '5f928fdc-791e-4821-b088-039c140695e9', 'port_id': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 111, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'mac_address': 'fa:16:3e:9b:a4:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:21:29Z', 'updated_at': '2021-11-18T18:22:02Z', 'revision_number': 1, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:24Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:22:04.761602 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a3aef12-1a22-40c5-86cb-120dff8054c7 None None] The sync data for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi is: [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '64c90213-fc61-4b3c-9477-dae011bc2072', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'floating_ip_address': '172.27.1.229', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '5f928fdc-791e-4821-b088-039c140695e9', 'port_id': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 111, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'mac_address': 'fa:16:3e:9b:a4:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:21:29Z', 'updated_at': '2021-11-18T18:22:02Z', 'revision_number': 1, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:24Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:22:04.975541 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-175fe881-a1f1-4dd5-a258-7f9a007b1d8d None None] New status for floating IP 64c90213-fc61-4b3c-9477-dae011bc2072: ACTIVE {{(pid=102690) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:22:05.150521 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47adca8b-c3d1-40ab-b8b4-389666ed312e req-6aa8c4af-0795-4a2d-b806-3a50e91f7d36 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:05.152212 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-47adca8b-c3d1-40ab-b8b4-389666ed312e req-6aa8c4af-0795-4a2d-b806-3a50e91f7d36 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0640905 Nov 18 18:22:05.198499 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-47adca8b-c3d1-40ab-b8b4-389666ed312e req-9f8c67e4-144d-4c63-9cd3-15d936956ec9 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403895 Nov 18 18:22:05.352164 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd904caa-e444-4e84-a96e-148047731968 req-d82899c9-4dce-43ef-8165-6803c9a76ff1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:05.353626 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-dd904caa-e444-4e84-a96e-148047731968 req-d82899c9-4dce-43ef-8165-6803c9a76ff1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 919 time: 0.0825906 Nov 18 18:22:05.468845 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1de820-89af-4158-82bd-2199b43ea03a req-b37f8a30-e450-4036-93a3-57189222cd47 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:05.470294 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ef1de820-89af-4158-82bd-2199b43ea03a req-b37f8a30-e450-4036-93a3-57189222cd47 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0470166 Nov 18 18:22:05.516923 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ef1de820-89af-4158-82bd-2199b43ea03a req-fdd82140-0500-47de-8206-4f718e28799f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407052 Nov 18 18:22:05.613560 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44fcd2d-c322-4178-b101-13dac07be381 req-9da3128c-dc45-4a34-b360-1d01e233d896 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:05.614995 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b44fcd2d-c322-4178-b101-13dac07be381 req-9da3128c-dc45-4a34-b360-1d01e233d896 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 945 time: 0.0466249 Nov 18 18:22:05.663705 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b44fcd2d-c322-4178-b101-13dac07be381 req-bf1ba9b3-d743-4ac0-beb2-d53f4e4fd764 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422134 Nov 18 18:22:06.310164 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a28dcb2-5bef-456d-8251-57c21ab21642 req-689cdef9-ff4c-4b95-927c-320d24d199a1 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:06.311620 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2a28dcb2-5bef-456d-8251-57c21ab21642 req-689cdef9-ff4c-4b95-927c-320d24d199a1 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0467925 Nov 18 18:22:06.357683 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2a28dcb2-5bef-456d-8251-57c21ab21642 req-a0e29774-d44d-4403-920e-4cebd9e4fcbd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401671 Nov 18 18:22:06.415732 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-6a58f2e5-07af-4470-82f7-327037ea9a3b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:06.626807 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6135abe3-83aa-4a51-8f56-15ab00db4aba req-f4fd8e51-69d1-4791-a0e1-95efceffb148 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:06.628369 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6135abe3-83aa-4a51-8f56-15ab00db4aba req-f4fd8e51-69d1-4791-a0e1-95efceffb148 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0469790 Nov 18 18:22:06.673114 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6135abe3-83aa-4a51-8f56-15ab00db4aba req-139bb397-a5af-40b5-b106-423d7891bcc1 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389774 Nov 18 18:22:06.780681 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2e9271b-61d8-4b47-9786-84eefaf9ef54 req-be159142-24d6-4809-9828-1cb579ef562e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:06.782077 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f2e9271b-61d8-4b47-9786-84eefaf9ef54 req-be159142-24d6-4809-9828-1cb579ef562e tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 945 time: 0.0548420 Nov 18 18:22:06.827272 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f2e9271b-61d8-4b47-9786-84eefaf9ef54 req-a297d964-e81a-42d7-a10f-d60c36926248 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387073 Nov 18 18:22:07.470008 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86b4119f-0b99-4e72-8252-edef23677467 req-f6b7b5bd-7354-4e36-b435-5e624a026bd0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:07.471493 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-86b4119f-0b99-4e72-8252-edef23677467 req-f6b7b5bd-7354-4e36-b435-5e624a026bd0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0478120 Nov 18 18:22:07.517897 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-86b4119f-0b99-4e72-8252-edef23677467 req-cd7812ac-2576-4e9d-9665-2964c9f8f0eb tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402217 Nov 18 18:22:07.654383 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-dd904caa-e444-4e84-a96e-148047731968 req-0656d5ca-d759-4ca1-9816-5dc272bd4a86 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b8ded38f-97b4-485b-9845-705c1fb9701d HTTP/1.1" status: 200 len: 1001 time: 0.0970140 Nov 18 18:22:07.700537 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:07.712342 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd904caa-e444-4e84-a96e-148047731968 req-7fef9dfc-56b8-437e-9fb9-8520d5aea7e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:07.713884 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-dd904caa-e444-4e84-a96e-148047731968 req-7fef9dfc-56b8-437e-9fb9-8520d5aea7e7 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 200 len: 856 time: 0.0494664 Nov 18 18:22:07.796368 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd904caa-e444-4e84-a96e-148047731968 req-443bba42-30fe-41ec-afa6-63e006ed53c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:07.798174 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-dd904caa-e444-4e84-a96e-148047731968 req-443bba42-30fe-41ec-afa6-63e006ed53c0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d845755f-6a59-4935-8123-1a70c6e45968&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0477498 Nov 18 18:22:07.818121 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7af2d0f3-e61f-4f6e-b269-3ca930a92d5c req-bf494045-8b65-4c58-806e-349ba00eac00 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:07.820235 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7af2d0f3-e61f-4f6e-b269-3ca930a92d5c req-bf494045-8b65-4c58-806e-349ba00eac00 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0798254 Nov 18 18:22:07.823035 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f595ab-33fe-473e-8518-bf67853abace req-3eddea80-c334-44bb-b749-4037d1f9f4ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:07.824463 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-20f595ab-33fe-473e-8518-bf67853abace req-3eddea80-c334-44bb-b749-4037d1f9f4ac service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 1098 time: 0.0747917 Nov 18 18:22:07.906475 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7af2d0f3-e61f-4f6e-b269-3ca930a92d5c req-63d64406-5d29-472a-bc12-10b2335457f2 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0803249 Nov 18 18:22:07.910147 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-dd904caa-e444-4e84-a96e-148047731968 req-599fad13-1458-47f3-8c3a-04aefeb03bf1 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1026375 Nov 18 18:22:07.910324 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-20f595ab-33fe-473e-8518-bf67853abace req-4f8571ed-f7d9-4ec0-8042-6bd5ee18cde5 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0708990 Nov 18 18:22:07.989796 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a759d4-00f3-48c8-96f1-5486025489ae req-c66758dd-92e2-4e2a-9aad-40ff68044b68 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:07.992000 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b9a759d4-00f3-48c8-96f1-5486025489ae req-c66758dd-92e2-4e2a-9aad-40ff68044b68 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 945 time: 0.0491011 Nov 18 18:22:08.041147 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b9a759d4-00f3-48c8-96f1-5486025489ae req-5334d3bb-c912-449e-b235-e51d5dbae93b tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432842 Nov 18 18:22:08.312030 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-dd904caa-e444-4e84-a96e-148047731968 req-f39d6f4e-6263-46f7-90a9-494b5707adc6 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1066952 Nov 18 18:22:08.636218 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-737f2226-f5a9-4c03-ab78-fc23c6ebfdd7 req-d4fc21bb-bfc4-4aeb-ae5d-de92428939a7 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:08.637722 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-737f2226-f5a9-4c03-ab78-fc23c6ebfdd7 req-d4fc21bb-bfc4-4aeb-ae5d-de92428939a7 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0505259 Nov 18 18:22:08.695414 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-737f2226-f5a9-4c03-ab78-fc23c6ebfdd7 req-2c0385fa-e5e2-4def-a3ed-306f04d80fd6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0510597 Nov 18 18:22:09.024884 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d52d0e3-71cb-4afc-b4d1-2cce8ebf6678 req-35069f31-161e-4308-ac52-0b6419294f9f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:09.026229 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:09.026753 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6d52d0e3-71cb-4afc-b4d1-2cce8ebf6678 req-35069f31-161e-4308-ac52-0b6419294f9f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0511718 Nov 18 18:22:09.081437 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6d52d0e3-71cb-4afc-b4d1-2cce8ebf6678 req-e6690a5b-cb37-48a9-8751-bf162a3938e8 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487354 Nov 18 18:22:09.179231 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fc484b-c7eb-4e6f-bfeb-1a83511381f4 req-cbf071bf-4601-4467-af67-227199d0dddb tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:09.181432 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-79fc484b-c7eb-4e6f-bfeb-1a83511381f4 req-cbf071bf-4601-4467-af67-227199d0dddb tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 945 time: 0.0549986 Nov 18 18:22:09.242803 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-79fc484b-c7eb-4e6f-bfeb-1a83511381f4 req-85859372-c52c-4282-9b7a-0028dab4e37a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540700 Nov 18 18:22:09.899802 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8116d475-73fd-4703-9bba-8ea132f5b70e req-7241f069-db41-404c-9606-9dabfdc46181 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:09.900811 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca6643d5-0c30-4cf8-ac15-564bcfaaf360 req-1312f990-d0ed-4f17-93ef-9b242f38f020 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:09.901840 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8116d475-73fd-4703-9bba-8ea132f5b70e req-7241f069-db41-404c-9606-9dabfdc46181 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0878642 Nov 18 18:22:09.903010 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ca6643d5-0c30-4cf8-ac15-564bcfaaf360 req-1312f990-d0ed-4f17-93ef-9b242f38f020 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.31 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 945 time: 0.1759067 Nov 18 18:22:09.965540 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8116d475-73fd-4703-9bba-8ea132f5b70e req-21f2c9c3-e793-47e6-8bfd-89e2bcc9835d tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0560918 Nov 18 18:22:10.129677 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [req-ca6643d5-0c30-4cf8-ac15-564bcfaaf360 req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Deleting port 277548fe-9144-4153-ba17-e53c37a98205 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:22:10.130102 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-ca6643d5-0c30-4cf8-ac15-564bcfaaf360 req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:10.177426 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:10.226179 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-39d98edd-3d35-4455-947b-036928e894f4 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:10.227625 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-39d98edd-3d35-4455-947b-036928e894f4 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 815 time: 0.1413369 Nov 18 18:22:10.249308 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb0a2c66-c926-4ea2-ac0d-edebbc4c75da req-4c24586e-59a3-4c39-9a54-bf9ae5255474 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:10.250854 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fb0a2c66-c926-4ea2-ac0d-edebbc4c75da req-4c24586e-59a3-4c39-9a54-bf9ae5255474 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0812144 Nov 18 18:22:10.255194 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-30d0baea-bd35-4ac9-a110-7dd9f98de2db tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/quotas/eed6400cd0414bc5a520c9886c2a4bde HTTP/1.1" status: 200 len: 375 time: 0.0200877 Nov 18 18:22:10.336270 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-cddb319d-9b6d-423b-9c3b-1c56ddf53b89 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0743921 Nov 18 18:22:10.339675 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fb0a2c66-c926-4ea2-ac0d-edebbc4c75da req-7d3fe075-50b3-4759-8642-3e3fd228283f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684106 Nov 18 18:22:10.426719 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-ca6643d5-0c30-4cf8-ac15-564bcfaaf360 req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] For port 277548fe-9144-4153-ba17-e53c37a98205, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=277548fe-9144-4153-ba17-e53c37a98205,segment=NetworkSegment(75f5638d-c7c3-4b9a-9271-1a7bc4fecb74),segment_id=75f5638d-c7c3-4b9a-9271-1a7bc4fecb74)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:22:10.427087 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-ca6643d5-0c30-4cf8-ac15-564bcfaaf360 req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:10.442636 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [req-ca6643d5-0c30-4cf8-ac15-564bcfaaf360 req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Calling delete_port for 277548fe-9144-4153-ba17-e53c37a98205 owned by compute:nova {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:22:10.468604 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-3902c880-add0-498a-a3a1-9fd08f31e39e service neutron] 10.222.0.82 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1237590 Nov 18 18:22:10.482161 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d67aca0-fa75-4714-b22c-9bafeb00eb1a req-cf0da148-1979-421b-b8cc-aff75808b307 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:10.483978 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2d67aca0-fa75-4714-b22c-9bafeb00eb1a req-cf0da148-1979-421b-b8cc-aff75808b307 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 945 time: 0.0690169 Nov 18 18:22:10.595340 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2d67aca0-fa75-4714-b22c-9bafeb00eb1a req-06f14a18-b415-4604-b098-c2330b17388d tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/security-groups?id=bd92f142-962d-42fa-b4d8-43c5f7b2b04a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1023195 Nov 18 18:22:10.627558 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-36917b7f-f4db-44b9-9666-72450c8a7ce6 service neutron] 10.222.0.82 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1424410 Nov 18 18:22:10.651749 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-ca6643d5-0c30-4cf8-ac15-564bcfaaf360 req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:10.669549 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['277548fe-9144-4153-ba17-e53c37a98205'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:22:10.701992 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Pushing event deleted for resources: {'Port': ['ID=277548fe-9144-4153-ba17-e53c37a98205,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:10.737420 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:10.737790 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:10.738225 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:10.738492 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:10.738833 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:10.739172 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:10.739510 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:10.739849 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:10.740214 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:10.741091 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:10.741993 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:10.741993 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:10.796330 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca6643d5-0c30-4cf8-ac15-564bcfaaf360 req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] No DVR routers for this DVR port 277548fe-9144-4153-ba17-e53c37a98205 on host hv-cinder-78776 {{(pid=102688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:22:10.799455 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-ca6643d5-0c30-4cf8-ac15-564bcfaaf360 req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:10.803714 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ca6643d5-0c30-4cf8-ac15-564bcfaaf360 req-defc8c34-9438-4cf2-99e8-b33459ff763a tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.31 "DELETE /v2.0/ports/277548fe-9144-4153-ba17-e53c37a98205 HTTP/1.1" status: 204 len: 173 time: 0.8855972 Nov 18 18:22:10.804254 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9aad4c1-c9a9-4ede-b085-5d2c7455014e', 'name': 'network-vif-deleted', 'tag': '277548fe-9144-4153-ba17-e53c37a98205'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:22:10.807111 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b191c365-46ff-4522-848d-470a6e51dd35" -d '{"events": [{"server_uuid": "e9aad4c1-c9a9-4ede-b085-5d2c7455014e", "name": "network-vif-deleted", "tag": "277548fe-9144-4153-ba17-e53c37a98205"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:22:10.852570 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:22:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54ca52c5-00b0-4528-9368-ef92c6079825 x-openstack-request-id: req-54ca52c5-00b0-4528-9368-ef92c6079825 {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:22:10.852773 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f3c8a91c-11cd-4c4d-83f2-56025e784afb req-e9751c71-7faa-4387-889e-79a4bb4fb852 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.0401564 Nov 18 18:22:10.853087 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9aad4c1-c9a9-4ede-b085-5d2c7455014e", "name": "network-vif-deleted", "tag": "277548fe-9144-4153-ba17-e53c37a98205", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:22:10.853571 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-54ca52c5-00b0-4528-9368-ef92c6079825 {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:22:10.854082 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9aad4c1-c9a9-4ede-b085-5d2c7455014e', 'name': 'network-vif-deleted', 'tag': '277548fe-9144-4153-ba17-e53c37a98205', 'status': 'completed', 'code': 200} Nov 18 18:22:10.913625 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 37128) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:11.050029 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:11.186589 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad6af33-84a8-4807-9b56-fe63d41d1f25 req-c4c9a248-ddb8-4d0e-b0b3-f021b40454c6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:11.188185 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aad6af33-84a8-4807-9b56-fe63d41d1f25 req-c4c9a248-ddb8-4d0e-b0b3-f021b40454c6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0979550 Nov 18 18:22:11.235325 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:11.241766 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:11.298578 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aad6af33-84a8-4807-9b56-fe63d41d1f25 req-57f33802-ad1a-4cc2-9a40-4ee647104faa tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0961018 Nov 18 18:22:11.304387 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5fce3dc007dd47798c6365986df66eea&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3896992 Nov 18 18:22:11.305062 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 37150) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:11.305964 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d913386-1ebc-41a4-9c7c-1c194d9cede5,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:11.316155 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:11.316505 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:11.316860 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:11.317204 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:11.317534 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:11.317870 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:11.318203 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:11.318597 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:11.318931 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:11.319259 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:11.319618 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:11.320020 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17473da5-d29d-4aa3-a442-5fc87aa0fe0b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:11.361212 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-020f2bae-2fe0-4fc9-8f87-aa45a1b601d6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:11.394754 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-020f2bae-2fe0-4fc9-8f87-aa45a1b601d6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:11.452754 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-020f2bae-2fe0-4fc9-8f87-aa45a1b601d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:11.455590 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-020f2bae-2fe0-4fc9-8f87-aa45a1b601d6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:11.457011 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-020f2bae-2fe0-4fc9-8f87-aa45a1b601d6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3d913386-1ebc-41a4-9c7c-1c194d9cede5 HTTP/1.1" status: 204 len: 168 time: 0.1501200 Nov 18 18:22:11.467204 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-020f2bae-2fe0-4fc9-8f87-aa45a1b601d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d913386-1ebc-41a4-9c7c-1c194d9cede5,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:11.473611 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73fa808d-b232-47af-8c12-c554ea388743 req-b77b2cf0-1d24-4da8-b9f0-7a693d8bf3ce tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:11.475754 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-73fa808d-b232-47af-8c12-c554ea388743 req-b77b2cf0-1d24-4da8-b9f0-7a693d8bf3ce tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0941718 Nov 18 18:22:11.484822 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 37158) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:11.490357 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-962e525a-2394-46a7-95f1-1f285aa19d4e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Request body: {'floatingip': {'port_id': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:22:11.534158 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-962e525a-2394-46a7-95f1-1f285aa19d4e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:11.546178 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e37e58a-7979-4743-9d75-92de1ff155cf req-4434e3e0-4248-4135-9f49-6d711657b91b tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:11.547668 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e37e58a-7979-4743-9d75-92de1ff155cf req-4434e3e0-4248-4135-9f49-6d711657b91b tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.1237416 Nov 18 18:22:11.690958 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e37e58a-7979-4743-9d75-92de1ff155cf req-07dbd294-5ebe-4091-b45e-159bb55ee4bc tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1129258 Nov 18 18:22:11.770257 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0d47aaf8-719f-48d0-8b56-530cc8fe1fb0 req-a50ec49c-583f-4bac-beb6-4c16a88575a1 tempest-DeleteServersTestJSON-1525127783 tempest-DeleteServersTestJSON-1525127783-project] 10.222.0.82 "GET /v2.0/ports?device_id=e9aad4c1-c9a9-4ede-b085-5d2c7455014e HTTP/1.1" status: 200 len: 210 time: 0.0322459 Nov 18 18:22:11.845377 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 37178) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:11.862314 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8e868fa9-cbad-47e5-ba98-592d0c6053fd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:11.963423 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8e868fa9-cbad-47e5-ba98-592d0c6053fd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:11.970379 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8e868fa9-cbad-47e5-ba98-592d0c6053fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.009155 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-35edd9ab-a799-46b1-9403-b5f2270eeb8e req-052192c9-ba17-4939-afd6-12eec671996a tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.0389752 Nov 18 18:22:12.024289 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-8e868fa9-cbad-47e5-ba98-592d0c6053fd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=288ee87a929c44e4b16ba89943988ad6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1776729 Nov 18 18:22:12.025205 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e868fa9-cbad-47e5-ba98-592d0c6053fd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=258761d6-69a7-47ce-952f-32da239ee907,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:12.040223 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 37184) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:12.121364 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 37190) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:12.143106 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dee1ef15-386c-40e9-97f7-3880b3bd762a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.161277 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-962e525a-2394-46a7-95f1-1f285aa19d4e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.166680 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-962e525a-2394-46a7-95f1-1f285aa19d4e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.168871 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dee1ef15-386c-40e9-97f7-3880b3bd762a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.227004 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dee1ef15-386c-40e9-97f7-3880b3bd762a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.230367 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dee1ef15-386c-40e9-97f7-3880b3bd762a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.231813 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-dee1ef15-386c-40e9-97f7-3880b3bd762a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/258761d6-69a7-47ce-952f-32da239ee907 HTTP/1.1" status: 204 len: 168 time: 0.1887150 Nov 18 18:22:12.246774 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dee1ef15-386c-40e9-97f7-3880b3bd762a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=258761d6-69a7-47ce-952f-32da239ee907,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:12.257868 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28081ca3-7cd7-485a-9b81-7c898224adf2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.288683 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [None req-962e525a-2394-46a7-95f1-1f285aa19d4e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Floating IP ac740b22-02e4-4cee-b156-000f4ed202ba associated. External IP: 172.27.1.231, port: d5a1ed38-73b7-489f-8676-f9b3ae9bd34f. Nov 18 18:22:12.351610 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28081ca3-7cd7-485a-9b81-7c898224adf2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.358230 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28081ca3-7cd7-485a-9b81-7c898224adf2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.399699 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28081ca3-7cd7-485a-9b81-7c898224adf2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=160e59a2-c058-41f2-9064-4fe6f6240573,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:12.407150 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 37202) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:12.407283 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-28081ca3-7cd7-485a-9b81-7c898224adf2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c0207c2e54e848f0af4ba0b232098801&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2849832 Nov 18 18:22:12.510357 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c74c8a15-795c-4006-be50-6f6f15eebfc6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.567451 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c74c8a15-795c-4006-be50-6f6f15eebfc6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.584315 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-962e525a-2394-46a7-95f1-1f285aa19d4e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Router 9674107a-752c-42c3-a133-60c85d951af8 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:22:12.673717 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c74c8a15-795c-4006-be50-6f6f15eebfc6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.677180 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c74c8a15-795c-4006-be50-6f6f15eebfc6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.679008 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-c74c8a15-795c-4006-be50-6f6f15eebfc6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/160e59a2-c058-41f2-9064-4fe6f6240573 HTTP/1.1" status: 204 len: 168 time: 0.2707942 Nov 18 18:22:12.731306 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c74c8a15-795c-4006-be50-6f6f15eebfc6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=160e59a2-c058-41f2-9064-4fe6f6240573,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:12.786769 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-962e525a-2394-46a7-95f1-1f285aa19d4e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:22:12.801295 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26466fb5-16de-41cd-8b1b-58ac9a14cee9 None None] Sync routers for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:22:12.807311 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-962e525a-2394-46a7-95f1-1f285aa19d4e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:12.821962 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26466fb5-16de-41cd-8b1b-58ac9a14cee9 None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:22:12.822687 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-26466fb5-16de-41cd-8b1b-58ac9a14cee9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:22:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:22:12.865203 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-e9cb6bc4-1a12-4b66-89c8-2b251490cb09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:12.867198 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-e9cb6bc4-1a12-4b66-89c8-2b251490cb09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 815 time: 0.1777513 Nov 18 18:22:12.904476 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-962e525a-2394-46a7-95f1-1f285aa19d4e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "PUT /v2.0/floatingips/ac740b22-02e4-4cee-b156-000f4ed202ba HTTP/1.1" status: 200 len: 991 time: 1.4152441 Nov 18 18:22:12.904476 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'tag': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:22:12.906538 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f970688-18d4-4ba4-930c-bd630136b3be" -d '{"events": [{"name": "network-changed", "server_uuid": "f928d38b-4f6c-47f6-a2e4-70767777e67e", "tag": "d5a1ed38-73b7-489f-8676-f9b3ae9bd34f"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:22:12.916080 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Request body: {'port': {'device_id': '1528250f-fcf0-4087-bde5-cf0ed83e5cba', 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1', 'admin_state_up': True, 'tenant_id': 'eed6400cd0414bc5a520c9886c2a4bde'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:22:12.922086 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-764fa23b-9895-4e93-a3d8-6f9c26c1d4c7 req-146f91ce-5b86-4d98-9046-80fdfb0c99f1 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:12.930262 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-764fa23b-9895-4e93-a3d8-6f9c26c1d4c7 req-146f91ce-5b86-4d98-9046-80fdfb0c99f1 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0771058 Nov 18 18:22:12.997104 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-764fa23b-9895-4e93-a3d8-6f9c26c1d4c7 req-f56ecff2-2944-4345-b3f7-0fb9d4c9e8d7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656953 Nov 18 18:22:13.101503 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:22:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e8696304-bbbd-4582-9c01-f4057daa5b37 x-openstack-request-id: req-e8696304-bbbd-4582-9c01-f4057daa5b37 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:22:13.102141 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f928d38b-4f6c-47f6-a2e4-70767777e67e", "tag": "d5a1ed38-73b7-489f-8676-f9b3ae9bd34f", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:22:13.102141 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-e8696304-bbbd-4582-9c01-f4057daa5b37 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:22:13.102451 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'tag': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f', 'status': 'completed', 'code': 200} Nov 18 18:22:13.112915 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-26466fb5-16de-41cd-8b1b-58ac9a14cee9 None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:22:13.136889 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Made reservation on behalf of eed6400cd0414bc5a520c9886c2a4bde for: {'port': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:22:13.142879 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:13.336138 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1bc6ac1f-b89d-472b-809f-bb45dfe07aa5 req-274b4f96-a084-4228-9e0e-0d6206d60016 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.1118317 Nov 18 18:22:13.361272 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f970688-18d4-4ba4-930c-bd630136b3be req-4c2f8abc-e499-49ff-8653-8cd2b475e7d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:13.363340 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9f970688-18d4-4ba4-930c-bd630136b3be req-4c2f8abc-e499-49ff-8653-8cd2b475e7d4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1bab99f3344342578dc7b1c29b1ced7e&device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 1098 time: 0.1959400 Nov 18 18:22:13.449289 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Allocated IP 172.20.0.6 (14ac84aa-8c04-4323-8592-aecfbb5a7fe1/488ef4e4-e6f9-414a-b93f-aabd7b232f9e/1b418eab-96c7-4da9-ba41-6e91026f7285) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:22:13.476384 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-26466fb5-16de-41cd-8b1b-58ac9a14cee9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': 'ac740b22-02e4-4cee-b156-000f4ed202ba', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'floating_ip_address': '172.27.1.231', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '9674107a-752c-42c3-a133-60c85d951af8', 'port_id': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 145, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'mac_address': 'fa:16:3e:c5:2a:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:21:41Z', 'updated_at': '2021-11-18T18:22:12Z', 'revision_number': 1, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:38Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:22:13.596209 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26466fb5-16de-41cd-8b1b-58ac9a14cee9 None None] Checking router: 9674107a-752c-42c3-a133-60c85d951af8 for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:22:13.605535 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26466fb5-16de-41cd-8b1b-58ac9a14cee9 None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:22:13.606359 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-26466fb5-16de-41cd-8b1b-58ac9a14cee9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:22:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:22:13.620336 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:13.639874 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f970688-18d4-4ba4-930c-bd630136b3be req-a08f5668-2157-4e39-a448-eb22fa46f2d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:13.641570 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9f970688-18d4-4ba4-930c-bd630136b3be req-a08f5668-2157-4e39-a448-eb22fa46f2d0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=f2a08e65-1c6c-43fe-a019-78643e62bd9f HTTP/1.1" status: 200 len: 912 time: 0.2653587 Nov 18 18:22:13.666245 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:13.687625 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['f3483de4-481b-47ac-8d51-f8457fd0bb85'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:22:13.735094 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-26466fb5-16de-41cd-8b1b-58ac9a14cee9 None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:22:13.817772 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:22:13.832883 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Pushing event updated for resources: {'Port': ['ID=1b418eab-96c7-4da9-ba41-6e91026f7285,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:13.840977 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:22:13.848892 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:22:13.857950 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:13.864190 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:13.891396 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-22dfe8fb-2b4e-436b-bd3b-077271328d17 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9887798 Nov 18 18:22:13.901466 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9f970688-18d4-4ba4-930c-bd630136b3be req-468d2d89-1972-40a3-927c-9b1b7739d683 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f HTTP/1.1" status: 200 len: 999 time: 0.2469525 Nov 18 18:22:13.930627 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Request body: {'port': {'device_id': '1528250f-fcf0-4087-bde5-cf0ed83e5cba', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:22:14.001320 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 277548fe-9144-4153-ba17-e53c37a98205 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:22:14.023941 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:14.032914 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-26466fb5-16de-41cd-8b1b-58ac9a14cee9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': 'ac740b22-02e4-4cee-b156-000f4ed202ba', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'floating_ip_address': '172.27.1.231', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '9674107a-752c-42c3-a133-60c85d951af8', 'port_id': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 145, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'mac_address': 'fa:16:3e:c5:2a:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:21:41Z', 'updated_at': '2021-11-18T18:22:12Z', 'revision_number': 1, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:38Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:22:14.035174 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f970688-18d4-4ba4-930c-bd630136b3be req-4d552623-a168-4cc4-94c0-1520196046a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:14.040210 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9f970688-18d4-4ba4-930c-bd630136b3be req-4d552623-a168-4cc4-94c0-1520196046a3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=53535ce7-7c2a-450f-87e4-d092908ff080 HTTP/1.1" status: 200 len: 849 time: 0.1041193 Nov 18 18:22:14.046458 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: 277548fe-9144-4153-ba17-e53c37a98205 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:22:14.046804 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 277548fe-9144-4153-ba17-e53c37a98205 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:22:14.102390 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26466fb5-16de-41cd-8b1b-58ac9a14cee9 None None] The sync data for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi is: [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': 'ac740b22-02e4-4cee-b156-000f4ed202ba', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'floating_ip_address': '172.27.1.231', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '9674107a-752c-42c3-a133-60c85d951af8', 'port_id': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 145, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'mac_address': 'fa:16:3e:c5:2a:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:21:41Z', 'updated_at': '2021-11-18T18:22:12Z', 'revision_number': 1, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:38Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:22:14.413267 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1b418eab-96c7-4da9-ba41-6e91026f7285 {{(pid=102688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:22:14.434513 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:14.462589 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.provisioning_blocks [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Transition to ACTIVE for port object 1b418eab-96c7-4da9-ba41-6e91026f7285 will not be triggered until provisioned by entity L2. {{(pid=102688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:22:14.478389 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:14.495528 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bb6c0fa-f6c6-4656-bd9e-d86d93a0a993 None None] New status for floating IP ac740b22-02e4-4cee-b156-000f4ed202ba: ACTIVE {{(pid=102690) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:22:14.542226 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63fabcc7-237f-4942-907f-4f905ec96591 req-440118e9-794a-4a22-ba69-aac6b73d681d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:14.543767 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-63fabcc7-237f-4942-907f-4f905ec96591 req-440118e9-794a-4a22-ba69-aac6b73d681d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.4605951 Nov 18 18:22:14.562078 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f970688-18d4-4ba4-930c-bd630136b3be req-2b70cb0c-af1d-4054-bb7b-53d615798d19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:14.563589 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9f970688-18d4-4ba4-930c-bd630136b3be req-2b70cb0c-af1d-4054-bb7b-53d615798d19 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f2a08e65-1c6c-43fe-a019-78643e62bd9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.4942062 Nov 18 18:22:14.628201 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Pushing event updated for resources: {'Port': ['ID=1b418eab-96c7-4da9-ba41-6e91026f7285,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:14.653472 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Attempting to bind port 1b418eab-96c7-4da9-ba41-6e91026f7285 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:22:14.654000 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Attempting to bind port 1b418eab-96c7-4da9-ba41-6e91026f7285 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:22:14.654502 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Attempting to bind port 1b418eab-96c7-4da9-ba41-6e91026f7285 on network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:22:14.661262 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Port 1b418eab-96c7-4da9-ba41-6e91026f7285 on network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:22:14.661592 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Attempting to bind port 1b418eab-96c7-4da9-ba41-6e91026f7285 on network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:22:14.673116 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 21, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:22:14.673484 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Checking segment: {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:22:14.673847 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Bound using segment: {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:22:14.674299 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Bound port: 1b418eab-96c7-4da9-ba41-6e91026f7285, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'}}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:22:14.674656 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:14.695172 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5defc8db-4750-46ee-a6bf-57322586a1b3 req-38efc9f6-71e5-4905-8015-db80b7c4e0c2 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:14.702446 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5defc8db-4750-46ee-a6bf-57322586a1b3 req-38efc9f6-71e5-4905-8015-db80b7c4e0c2 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 943 time: 0.1448185 Nov 18 18:22:14.777653 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-63fabcc7-237f-4942-907f-4f905ec96591 req-c52885d4-864e-41ce-8da7-413b9300b30d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2189341 Nov 18 18:22:14.842540 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] For port 1b418eab-96c7-4da9-ba41-6e91026f7285, host hv-cinder-78776, cleared binding levels {{(pid=102688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:22:14.852247 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] For port 1b418eab-96c7-4da9-ba41-6e91026f7285, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=1b418eab-96c7-4da9-ba41-6e91026f7285,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:22:14.855984 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5defc8db-4750-46ee-a6bf-57322586a1b3 req-bc40e56e-1dc3-480e-836f-2b60bd640eda tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1525450 Nov 18 18:22:14.858784 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9f970688-18d4-4ba4-930c-bd630136b3be req-8e3f01ca-e4a1-4b68-aac8-e7394d0c1b3a service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2566788 Nov 18 18:22:14.860849 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:14.898812 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:14.899439 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:14.900881 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] 10.222.0.31 "PUT /v2.0/ports/1b418eab-96c7-4da9-ba41-6e91026f7285 HTTP/1.1" status: 200 len: 1093 time: 0.9761190 Nov 18 18:22:14.903327 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1528250f-fcf0-4087-bde5-cf0ed83e5cba', 'tag': '1b418eab-96c7-4da9-ba41-6e91026f7285'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:22:14.907298 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd8bc841-32fc-40e4-abea-b5752678812a" -d '{"events": [{"name": "network-changed", "server_uuid": "1528250f-fcf0-4087-bde5-cf0ed83e5cba", "tag": "1b418eab-96c7-4da9-ba41-6e91026f7285"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:22:15.062519 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 37372) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:15.069210 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:22:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7fd03709-0e1d-48c6-bcd8-c83cddc0b234 x-openstack-request-id: req-7fd03709-0e1d-48c6-bcd8-c83cddc0b234 {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:22:15.069510 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1528250f-fcf0-4087-bde5-cf0ed83e5cba", "tag": "1b418eab-96c7-4da9-ba41-6e91026f7285", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:22:15.070279 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-7fd03709-0e1d-48c6-bcd8-c83cddc0b234 {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:22:15.070279 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1528250f-fcf0-4087-bde5-cf0ed83e5cba', 'tag': '1b418eab-96c7-4da9-ba41-6e91026f7285', 'status': 'completed', 'code': 200} Nov 18 18:22:15.074245 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fcf28bf-6eec-4c5f-bc58-a63604caf03a service neutron] Pushing event updated for resources: {'Port': ['ID=1b418eab-96c7-4da9-ba41-6e91026f7285,revision_number=3']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:15.080511 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-eb121a8e-1a89-49b2-a652-b4a85d63eeb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:15.083274 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-eb121a8e-1a89-49b2-a652-b4a85d63eeb5 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 1096 time: 0.0883296 Nov 18 18:22:15.116802 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9f970688-18d4-4ba4-930c-bd630136b3be req-11b475fe-d9c9-476b-8995-f04c29ba83c8 service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2389715 Nov 18 18:22:15.145793 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_v2 [None req-ccf72401-a0f5-4c4a-b318-bd18706a3c61 admin admin] Deleting subnet 487bf315-c9f3-4691-b915-cf15db298f82 {{(pid=102689) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:22:15.157425 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ccf72401-a0f5-4c4a-b318-bd18706a3c61 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:15.160807 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-1ffeecc1-aa35-4f9b-a064-b9669f8992c9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=1b418eab-96c7-4da9-ba41-6e91026f7285 HTTP/1.1" status: 200 len: 217 time: 0.0571625 Nov 18 18:22:15.210391 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ccf72401-a0f5-4c4a-b318-bd18706a3c61 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:15.222656 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ccf72401-a0f5-4c4a-b318-bd18706a3c61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:15.241817 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7b7db93f-91f3-43ec-a1e7-fee847a175b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:15.248046 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-7b7db93f-91f3-43ec-a1e7-fee847a175b0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=488ef4e4-e6f9-414a-b93f-aabd7b232f9e HTTP/1.1" status: 200 len: 855 time: 0.0693419 Nov 18 18:22:15.300160 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-fba6c593-2c11-4bc0-9cf4-eab5c8fa31f6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0313711 Nov 18 18:22:15.302495 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ccf72401-a0f5-4c4a-b318-bd18706a3c61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:15.335552 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ccf72401-a0f5-4c4a-b318-bd18706a3c61 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:15.339083 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-ccf72401-a0f5-4c4a-b318-bd18706a3c61 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/487bf315-c9f3-4691-b915-cf15db298f82 HTTP/1.1" status: 204 len: 168 time: 0.2755930 Nov 18 18:22:15.340374 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf72401-a0f5-4c4a-b318-bd18706a3c61 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=487bf315-c9f3-4691-b915-cf15db298f82,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:15.351351 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 37390) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:15.418569 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 37396) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:15.478525 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-9f0f1f4a-3224-4209-b8a9-1e3a57ea1c6b service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1545441 Nov 18 18:22:15.480546 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:15.575875 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:15.605279 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b13f7cf7-0582-41d5-a7a5-4b13cbbc8c74 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:15.611433 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.613700 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.613700 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.613700 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > port after_create 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.613700 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.613700 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > port after_update 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.614151 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.614151 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.614738 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.614738 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.617110 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-3467fbac-3d63-4443-8a05-6b72ab4067c8 req-12384314-2115-40ab-8029-14d504b20409 service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1113329 Nov 18 18:22:15.712714 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd8bc841-32fc-40e4-abea-b5752678812a req-ea0effd7-4fd4-4f7d-ac54-bb4d521de178 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:15.714271 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cd8bc841-32fc-40e4-abea-b5752678812a req-ea0effd7-4fd4-4f7d-ac54-bb4d521de178 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 1096 time: 0.0407245 Nov 18 18:22:15.729501 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 37406) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:15.782999 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.783353 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.783709 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.784107 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102689) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:22:15.784483 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7e134455-4777-4316-bbbd-bb2480fdc6bf']}} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:22:15.812569 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '75f5638d-c7c3-4b9a-9271-1a7bc4fecb74') {'for_net_delete': True} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:22:15.812863 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '75f5638d-c7c3-4b9a-9271-1a7bc4fecb74') {} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:22:15.836633 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12724807'] for segment, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:15.864601 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd8bc841-32fc-40e4-abea-b5752678812a req-306c7a2e-5e7e-49c4-a84a-80cd81a48f48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:15.867410 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cd8bc841-32fc-40e4-abea-b5752678812a req-306c7a2e-5e7e-49c4-a84a-80cd81a48f48 service neutron] 10.222.0.31 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 917 time: 0.1318619 Nov 18 18:22:15.870813 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:15.888653 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2c5408be-4da7-443a-b27e-8a479437fa5a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:15.893617 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Releasing vlan 1340 on physical network physnet1 to pool {{(pid=102689) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:22:15.894043 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12723877'] for segment, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: from cryptography.utils import int_from_bytes Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: from cryptography.utils import int_from_bytes Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: Traceback (most recent call last): Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: timer() Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: cb(*args, **kw) Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: return func(*args, **kwargs) Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: self._notify() Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: self.callback(batched_events) Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: event.method(event) Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: return f(self, *a, **k) Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._get(url).json() Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: return self.request(url, 'GET', **kwargs) Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:22:15.915655 dv-cinder-787764-6-iscsi neutron-server[102689]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:22:15.945653 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cd8bc841-32fc-40e4-abea-b5752678812a req-24bd9d0c-4bd0-482b-8334-3997beb8915c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=1b418eab-96c7-4da9-ba41-6e91026f7285 HTTP/1.1" status: 200 len: 217 time: 0.0467861 Nov 18 18:22:16.048330 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd8bc841-32fc-40e4-abea-b5752678812a req-b023b7d4-210b-49dd-9fb2-a1b338f4b566 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:16.050037 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cd8bc841-32fc-40e4-abea-b5752678812a req-b023b7d4-210b-49dd-9fb2-a1b338f4b566 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=488ef4e4-e6f9-414a-b93f-aabd7b232f9e HTTP/1.1" status: 200 len: 855 time: 0.0860529 Nov 18 18:22:16.074327 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.084427 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2c5408be-4da7-443a-b27e-8a479437fa5a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.102266 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cd8bc841-32fc-40e4-abea-b5752678812a req-79e145c2-3b04-4238-b23a-97c4c7ea9a6d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0375628 Nov 18 18:22:16.103070 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2c5408be-4da7-443a-b27e-8a479437fa5a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.105861 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92a52fa4-d1f5-45dc-a0a9-9233def26446 req-4cfee691-4a8e-442b-91ac-a8673661699d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:16.107539 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-92a52fa4-d1f5-45dc-a0a9-9233def26446 req-4cfee691-4a8e-442b-91ac-a8673661699d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.2275307 Nov 18 18:22:16.110783 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b13f7cf7-0582-41d5-a7a5-4b13cbbc8c74 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.112224 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.116149 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] 10.222.0.82 "DELETE /v2.0/networks/7e134455-4777-4316-bbbd-bb2480fdc6bf HTTP/1.1" status: 204 len: 168 time: 0.7630243 Nov 18 18:22:16.124109 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497afa4c-b6d9-4e4b-a4be-187df859c168 req-881d904f-6bdc-412d-a502-5dce8b92f914 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:16.125653 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-497afa4c-b6d9-4e4b-a4be-187df859c168 req-881d904f-6bdc-412d-a502-5dce8b92f914 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 943 time: 0.1672790 Nov 18 18:22:16.145997 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b13f7cf7-0582-41d5-a7a5-4b13cbbc8c74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.155961 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c5e0a89-f7d1-4b54-905b-c1926f11a4a8 admin admin] Pushing event deleted for resources: {'Network': ['ID=7e134455-4777-4316-bbbd-bb2480fdc6bf,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:16.177050 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c5408be-4da7-443a-b27e-8a479437fa5a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=041e240b-fdb8-4ef0-8d02-58b11a27686e,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:16.184621 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-2c5408be-4da7-443a-b27e-8a479437fa5a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=68ab9ce72f5b428db8aaf265d9aa6460&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4511995 Nov 18 18:22:16.184818 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 37430) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:16.232727 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b13f7cf7-0582-41d5-a7a5-4b13cbbc8c74 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5c94aef-81a2-43fa-9be0-76f29b70d2a5,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:16.253532 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-b13f7cf7-0582-41d5-a7a5-4b13cbbc8c74 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=252e6093af37482ab46c996dddf2b962&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8337698 Nov 18 18:22:16.254270 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 37432) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:16.275915 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-92a52fa4-d1f5-45dc-a0a9-9233def26446 req-558f17f3-b451-4511-8656-33e4d9fa3ccf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1492741 Nov 18 18:22:16.289215 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cd8bc841-32fc-40e4-abea-b5752678812a req-a99c06b0-5518-4f80-ad6e-968aa625be51 service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1651106 Nov 18 18:22:16.298562 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-46b78560-405c-4b93-9221-3994cf2b1438 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.298922 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-497afa4c-b6d9-4e4b-a4be-187df859c168 req-14f84cc9-844c-4afc-85fa-c7282bac3ca1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1480451 Nov 18 18:22:16.315738 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 37434) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:16.338651 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-46b78560-405c-4b93-9221-3994cf2b1438 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.370718 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d6f19543-71c2-463a-ba2b-158e348964dc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.384424 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-7dc2a17e-b3bd-4cd6-a18d-b673df834666 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=83eb53a057ad4d528a3e2875be10dd97&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0675285 Nov 18 18:22:16.388966 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 37436) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:16.398894 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d6f19543-71c2-463a-ba2b-158e348964dc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.465165 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d6f19543-71c2-463a-ba2b-158e348964dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.470153 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cd8bc841-32fc-40e4-abea-b5752678812a req-95fdc671-723f-4314-be0b-aa7020e55186 service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1620750 Nov 18 18:22:16.482133 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d6f19543-71c2-463a-ba2b-158e348964dc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.487512 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-46b78560-405c-4b93-9221-3994cf2b1438 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.490609 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-46b78560-405c-4b93-9221-3994cf2b1438 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.491852 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-46b78560-405c-4b93-9221-3994cf2b1438 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/041e240b-fdb8-4ef0-8d02-58b11a27686e HTTP/1.1" status: 204 len: 168 time: 0.3061936 Nov 18 18:22:16.497722 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2d0b49e2-aafa-41dc-b70e-afb529d3e197 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.505124 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46b78560-405c-4b93-9221-3994cf2b1438 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=041e240b-fdb8-4ef0-8d02-58b11a27686e,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:16.509586 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-d6f19543-71c2-463a-ba2b-158e348964dc admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b5c94aef-81a2-43fa-9be0-76f29b70d2a5 HTTP/1.1" status: 204 len: 168 time: 0.2489543 Nov 18 18:22:16.530196 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2d0b49e2-aafa-41dc-b70e-afb529d3e197 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.533390 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6f19543-71c2-463a-ba2b-158e348964dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5c94aef-81a2-43fa-9be0-76f29b70d2a5,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:16.606040 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2d0b49e2-aafa-41dc-b70e-afb529d3e197 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.608685 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2d0b49e2-aafa-41dc-b70e-afb529d3e197 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:16.614264 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-2d0b49e2-aafa-41dc-b70e-afb529d3e197 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bd92f142-962d-42fa-b4d8-43c5f7b2b04a HTTP/1.1" status: 204 len: 168 time: 0.2155564 Nov 18 18:22:16.626330 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d0b49e2-aafa-41dc-b70e-afb529d3e197 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd92f142-962d-42fa-b4d8-43c5f7b2b04a,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:17.075754 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 37454) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:17.090829 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0e9c77bb-d9ec-472c-8273-d5c2f7d41ded admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.095133 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 37456) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:17.108789 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-74746442-e031-4ccf-ba3d-f551382e1a1e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.180397 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0e9c77bb-d9ec-472c-8273-d5c2f7d41ded admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.184589 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0e9c77bb-d9ec-472c-8273-d5c2f7d41ded admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.197460 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-74746442-e031-4ccf-ba3d-f551382e1a1e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.202376 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-74746442-e031-4ccf-ba3d-f551382e1a1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.226736 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-0e9c77bb-d9ec-472c-8273-d5c2f7d41ded admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e8424a0ca73f4e9d9c114985d102dbe4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1496801 Nov 18 18:22:17.229454 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e9c77bb-d9ec-472c-8273-d5c2f7d41ded admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b0393b2d-479a-460d-80b0-e5db4539c750,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:17.231781 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 37462) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:17.232655 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-74746442-e031-4ccf-ba3d-f551382e1a1e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9ac6bd9bb0354cf2ad449064f277878b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1357713 Nov 18 18:22:17.234173 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 37464) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:17.275228 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74746442-e031-4ccf-ba3d-f551382e1a1e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b4c897e-a1e9-41e1-8ac8-8b8f554fdd00,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:17.313365 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-707ec186-6ad2-47b9-836f-b04233cfbcbb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.323035 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3cfe2098-7d9b-4171-854f-946c82e56d64 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.358809 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-707ec186-6ad2-47b9-836f-b04233cfbcbb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.362750 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3cfe2098-7d9b-4171-854f-946c82e56d64 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.437925 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3cfe2098-7d9b-4171-854f-946c82e56d64 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.440718 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3cfe2098-7d9b-4171-854f-946c82e56d64 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.442072 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-3cfe2098-7d9b-4171-854f-946c82e56d64 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b0393b2d-479a-460d-80b0-e5db4539c750 HTTP/1.1" status: 204 len: 168 time: 0.2093668 Nov 18 18:22:17.472410 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cfe2098-7d9b-4171-854f-946c82e56d64 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b0393b2d-479a-460d-80b0-e5db4539c750,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:17.481318 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f1bb2d7-1d25-4ce1-a74c-6c951b4d4556 req-565882c4-1c4a-4b87-b5a7-c39b22b8b7ba tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:17.492225 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4f1bb2d7-1d25-4ce1-a74c-6c951b4d4556 req-565882c4-1c4a-4b87-b5a7-c39b22b8b7ba tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 943 time: 0.1174977 Nov 18 18:22:17.520675 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4c98e88-4183-4c8f-afb5-eb77af9dfea8 req-c4962f5d-e097-4095-8911-92561601d667 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:17.522211 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a4c98e88-4183-4c8f-afb5-eb77af9dfea8 req-c4962f5d-e097-4095-8911-92561601d667 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.1260102 Nov 18 18:22:17.522846 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-707ec186-6ad2-47b9-836f-b04233cfbcbb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.525501 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-707ec186-6ad2-47b9-836f-b04233cfbcbb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:17.528388 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-707ec186-6ad2-47b9-836f-b04233cfbcbb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3b4c897e-a1e9-41e1-8ac8-8b8f554fdd00 HTTP/1.1" status: 204 len: 168 time: 0.2932618 Nov 18 18:22:17.568267 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-707ec186-6ad2-47b9-836f-b04233cfbcbb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b4c897e-a1e9-41e1-8ac8-8b8f554fdd00,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:17.613151 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4f1bb2d7-1d25-4ce1-a74c-6c951b4d4556 req-2c6497ae-00d9-4c1b-95e3-23016e3d53fc tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1200576 Nov 18 18:22:17.618236 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a4c98e88-4183-4c8f-afb5-eb77af9dfea8 req-acd96506-885f-4b49-9e02-a100493eb25d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887630 Nov 18 18:22:17.994660 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 1b418eab-96c7-4da9-ba41-6e91026f7285 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:22:18.111137 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 1b418eab-96c7-4da9-ba41-6e91026f7285, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=1b418eab-96c7-4da9-ba41-6e91026f7285,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:22:18.127267 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '1b418eab-96c7-4da9-ba41-6e91026f7285', 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1', 'port_id': '1b418eab-96c7-4da9-ba41-6e91026f7285', 'mac_address': 'fa:16:3e:e6:36:83', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1303, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '488ef4e4-e6f9-414a-b93f-aabd7b232f9e', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:22:18.167455 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:18.181098 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1b418eab-96c7-4da9-ba41-6e91026f7285 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:22:18.200721 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 1b418eab-96c7-4da9-ba41-6e91026f7285, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=1b418eab-96c7-4da9-ba41-6e91026f7285,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:22:18.205128 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:18.259653 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=1b418eab-96c7-4da9-ba41-6e91026f7285,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:18.266827 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:18.267389 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:18.267743 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:18.268103 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:18.268620 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:18.268960 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:18.269290 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:18.269618 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:18.270108 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:18.270597 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:18.271069 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:18.272119 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:22:18.620130 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['1b418eab-96c7-4da9-ba41-6e91026f7285'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:22:18.796964 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 37554) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:18.877625 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0d834a-1508-44ef-9bed-50d6761c4040 req-d028b3b4-f34f-4b92-b53c-c6908bb1eb82 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:18.880345 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2c0d834a-1508-44ef-9bed-50d6761c4040 req-d028b3b4-f34f-4b92-b53c-c6908bb1eb82 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.1581078 Nov 18 18:22:18.897983 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10582034-905e-4a80-9814-a7d062869397 req-6628609a-5ca2-4657-bf74-030d6a1f1a70 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:18.905390 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-10582034-905e-4a80-9814-a7d062869397 req-6628609a-5ca2-4657-bf74-030d6a1f1a70 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 944 time: 0.1731429 Nov 18 18:22:18.943977 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-33b86930-2e41-4e24-b81e-215ab477dbe9 req-8b9e6251-5ccc-4473-8018-2297ba469fb1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0673611 Nov 18 18:22:18.991258 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-10582034-905e-4a80-9814-a7d062869397 req-65a42643-312d-4a59-8590-0ad68d0e64f2 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847201 Nov 18 18:22:19.048238 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2c0d834a-1508-44ef-9bed-50d6761c4040 req-b6bb7a0e-ff75-4fdc-9705-2a17c888192b tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1404245 Nov 18 18:22:19.096012 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b86930-2e41-4e24-b81e-215ab477dbe9 req-05b8e774-5159-484d-b0b4-07c66c94b2e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:19.097721 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-33b86930-2e41-4e24-b81e-215ab477dbe9 req-05b8e774-5159-484d-b0b4-07c66c94b2e6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 1098 time: 0.0903659 Nov 18 18:22:19.203352 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-324746130-network', 'tenant_id': '472f1c3f9a614eacab1165cd06691e36'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:22:19.276225 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Made reservation on behalf of 472f1c3f9a614eacab1165cd06691e36 for: {'network': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:22:19.278682 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:19.292671 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:19.303864 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b86930-2e41-4e24-b81e-215ab477dbe9 req-40e443ca-0c0f-439c-9fc1-46cf445b5cbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:19.305381 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-33b86930-2e41-4e24-b81e-215ab477dbe9 req-40e443ca-0c0f-439c-9fc1-46cf445b5cbb service neutron] 10.222.0.31 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 917 time: 0.1629303 Nov 18 18:22:19.357757 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-33b86930-2e41-4e24-b81e-215ab477dbe9 req-0175628c-8638-424d-96c4-df558aa263cf service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=f3483de4-481b-47ac-8d51-f8457fd0bb85 HTTP/1.1" status: 200 len: 217 time: 0.0428057 Nov 18 18:22:19.432417 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b86930-2e41-4e24-b81e-215ab477dbe9 req-f5bb3b3a-fd24-4659-be79-31834e23dd8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:19.433964 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-33b86930-2e41-4e24-b81e-215ab477dbe9 req-f5bb3b3a-fd24-4659-be79-31834e23dd8a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=488ef4e4-e6f9-414a-b93f-aabd7b232f9e HTTP/1.1" status: 200 len: 855 time: 0.0664241 Nov 18 18:22:19.457000 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:19.485100 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-33b86930-2e41-4e24-b81e-215ab477dbe9 req-61d0c6d7-c9e5-41af-85d7-c034b73414ab service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0266104 Nov 18 18:22:19.485825 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:19.515956 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1333} {{(pid=102688) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:22:19.544537 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff5c1222-8b6f-43f9-a79e-85bbc10341c5,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:19.560371 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:19.560641 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.segments_db [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Added segment d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20 of type vlan for network f06fa801-dbf4-454b-984e-82c11cc6c900 Nov 18 18:22:19.635432 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:19.659542 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-33b86930-2e41-4e24-b81e-215ab477dbe9 req-9fd68180-1c87-4386-a7b7-1f9f8ce97f16 service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1609387 Nov 18 18:22:19.681046 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:19.681940 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:19.682543 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:19.731179 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.9331253 Nov 18 18:22:19.734410 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 37622) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:22:19.739625 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-a35d3a78-2cab-4426-956f-96e799fcf815 admin admin] Request body: {'subnet': {'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-324746130-subnet', 'tenant_id': '472f1c3f9a614eacab1165cd06691e36', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:22:19.768071 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a35d3a78-2cab-4426-956f-96e799fcf815 admin admin] Made reservation on behalf of 472f1c3f9a614eacab1165cd06691e36 for: {'subnet': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:22:19.770510 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a35d3a78-2cab-4426-956f-96e799fcf815 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14479070'] for subnet, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:19.802163 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-940c9c56-f98c-4a9a-84fb-de16890607d2 admin admin] Pushing event updated for resources: {'Network': ['ID=f06fa801-dbf4-454b-984e-82c11cc6c900,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:19.827921 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network f06fa801-dbf4-454b-984e-82c11cc6c900 details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:22:19.828834 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-33b86930-2e41-4e24-b81e-215ab477dbe9 req-7732b7bd-bd61-4945-9fc7-679842c700e0 service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1569858 Nov 18 18:22:19.968405 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a35d3a78-2cab-4426-956f-96e799fcf815 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-12723770', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14479088'] for subnet, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:20.030770 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a35d3a78-2cab-4426-956f-96e799fcf815 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d477b94e-c409-446d-9434-db6811cbe863,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:20.041684 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a35d3a78-2cab-4426-956f-96e799fcf815 admin admin] Checking segment: {'id': 'd50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:22:20.042046 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a35d3a78-2cab-4426-956f-96e799fcf815 admin admin] Network hostable DHCP agents. Network: f06fa801-dbf4-454b-984e-82c11cc6c900, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102689) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:22:20.058063 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a35d3a78-2cab-4426-956f-96e799fcf815 admin admin] Network f06fa801-dbf4-454b-984e-82c11cc6c900 is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102689) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:22:20.066527 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-a35d3a78-2cab-4426-956f-96e799fcf815 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, f06fa801-dbf4-454b-984e-82c11cc6c900) {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:22:20.071576 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a35d3a78-2cab-4426-956f-96e799fcf815 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:20.072275 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a35d3a78-2cab-4426-956f-96e799fcf815 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:20.080316 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcd3d9d6-6559-4986-9537-c3f55f8e7cca None None] Network f06fa801-dbf4-454b-984e-82c11cc6c900 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:22:20.134456 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-a35d3a78-2cab-4426-956f-96e799fcf815 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3967993 Nov 18 18:22:20.201682 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-895fbb14-08ee-4c73-9564-806b9b2bff51 req-7c1bdfa4-e01f-4e37-ab9f-9162a730a8c1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:20.203968 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-895fbb14-08ee-4c73-9564-806b9b2bff51 req-7c1bdfa4-e01f-4e37-ab9f-9162a730a8c1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 944 time: 0.1090908 Nov 18 18:22:20.226712 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e32cb590-04dc-4637-911c-9b7afc36b177 None None] Network f06fa801-dbf4-454b-984e-82c11cc6c900 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:22:20.241948 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2402b21c-218e-4c81-bf9f-df9ced99c716 req-3bf98beb-4e71-4488-8eeb-6750d42535c7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:20.243448 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2402b21c-218e-4c81-bf9f-df9ced99c716 req-3bf98beb-4e71-4488-8eeb-6750d42535c7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0838656 Nov 18 18:22:20.282794 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-895fbb14-08ee-4c73-9564-806b9b2bff51 req-2f37df60-ffaa-442b-a9b5-6c717b9a667f tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725160 Nov 18 18:22:20.314184 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2402b21c-218e-4c81-bf9f-df9ced99c716 req-2ba10574-90ce-4831-8ad4-c9a4153a9f8f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0613308 Nov 18 18:22:20.991761 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:21.414183 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c82eba7-3f53-423e-a2f1-bdc6486ee42a req-f3319ca3-c0a8-49ca-b8c8-879c5b105b83 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:21.415708 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8c82eba7-3f53-423e-a2f1-bdc6486ee42a req-f3319ca3-c0a8-49ca-b8c8-879c5b105b83 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 944 time: 0.0628524 Nov 18 18:22:21.478978 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bee2e1-5ad0-4a14-8d5b-33ad2f1f6aa5 req-9814f087-fdc5-4e34-a853-659f31ca7243 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:21.480459 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-02bee2e1-5ad0-4a14-8d5b-33ad2f1f6aa5 req-9814f087-fdc5-4e34-a853-659f31ca7243 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0896165 Nov 18 18:22:21.487388 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8c82eba7-3f53-423e-a2f1-bdc6486ee42a req-009eb619-60ab-431d-b845-a4ed7152853b tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586996 Nov 18 18:22:21.537145 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-02bee2e1-5ad0-4a14-8d5b-33ad2f1f6aa5 req-99c6c3c7-b296-4e5b-91d0-7798ed076967 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488157 Nov 18 18:22:22.007987 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 1b418eab-96c7-4da9-ba41-6e91026f7285 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:22:22.057635 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port 1b418eab-96c7-4da9-ba41-6e91026f7285 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:22:22.061514 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 1b418eab-96c7-4da9-ba41-6e91026f7285 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:22:22.061888 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:22.145803 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:22.170379 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1528250f-fcf0-4087-bde5-cf0ed83e5cba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1b418eab-96c7-4da9-ba41-6e91026f7285'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:22:22.172930 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c8942896-858b-45bb-9e41-b9ec53b89a40" -d '{"events": [{"server_uuid": "1528250f-fcf0-4087-bde5-cf0ed83e5cba", "name": "network-vif-plugged", "status": "completed", "tag": "1b418eab-96c7-4da9-ba41-6e91026f7285"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:22:22.188197 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 1b418eab-96c7-4da9-ba41-6e91026f7285, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=1b418eab-96c7-4da9-ba41-6e91026f7285,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:22:22.195338 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:22.220940 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:22:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-92457c87-1f43-4297-a6e6-1e5b5fe79387 x-openstack-request-id: req-92457c87-1f43-4297-a6e6-1e5b5fe79387 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:22:22.221257 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1528250f-fcf0-4087-bde5-cf0ed83e5cba", "name": "network-vif-plugged", "status": "completed", "tag": "1b418eab-96c7-4da9-ba41-6e91026f7285", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:22:22.221518 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-92457c87-1f43-4297-a6e6-1e5b5fe79387 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:22:22.221966 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1528250f-fcf0-4087-bde5-cf0ed83e5cba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1b418eab-96c7-4da9-ba41-6e91026f7285', 'code': 200} Nov 18 18:22:22.251099 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=1b418eab-96c7-4da9-ba41-6e91026f7285,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:22.403967 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b150e79-b2ea-4789-b4ec-4a22d1d67b59 req-b729d4e5-1512-4ea6-bbcf-fe2209300b8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:22.405334 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-1b150e79-b2ea-4789-b4ec-4a22d1d67b59 req-b729d4e5-1512-4ea6-bbcf-fe2209300b8d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 1098 time: 0.0379355 Nov 18 18:22:22.464157 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-1b150e79-b2ea-4789-b4ec-4a22d1d67b59 req-c3f497c3-4205-4578-804f-2c0b04eab5ec service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402541 Nov 18 18:22:22.603187 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2995eb2a-8638-4330-81d7-cfdfbb08bf6a req-6aba08a1-09c1-4814-9406-611608ee98de tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:22.604717 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2995eb2a-8638-4330-81d7-cfdfbb08bf6a req-6aba08a1-09c1-4814-9406-611608ee98de tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 945 time: 0.0480793 Nov 18 18:22:22.650902 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2995eb2a-8638-4330-81d7-cfdfbb08bf6a req-4fd34c0f-6642-464e-99ce-e481b55867d2 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399597 Nov 18 18:22:22.754052 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2447704-ecf8-4a0a-95ff-1ab665314116 req-a470389d-214a-475e-830f-b99580fd4ad7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:22.755609 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c2447704-ecf8-4a0a-95ff-1ab665314116 req-a470389d-214a-475e-830f-b99580fd4ad7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0526006 Nov 18 18:22:22.802141 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c2447704-ecf8-4a0a-95ff-1ab665314116 req-beea3a73-0a9b-4b60-a309-b223b718f985 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405636 Nov 18 18:22:26.379098 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c72d119-dd29-4cf4-a3f3-4aca92dda035 req-d1bf6157-2bb1-45a6-ad30-aad99f09440b tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:26.380587 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c72d119-dd29-4cf4-a3f3-4aca92dda035 req-d1bf6157-2bb1-45a6-ad30-aad99f09440b tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 945 time: 0.0479796 Nov 18 18:22:26.426204 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c72d119-dd29-4cf4-a3f3-4aca92dda035 req-b82f08e8-210b-4546-9cfa-437e17185467 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391839 Nov 18 18:22:26.529584 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514938dc-e5ad-43cc-acb1-cb66dd8ba684 req-e006a271-855a-4dd7-acd5-53aea1600d1a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:26.531084 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-514938dc-e5ad-43cc-acb1-cb66dd8ba684 req-e006a271-855a-4dd7-acd5-53aea1600d1a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0499165 Nov 18 18:22:26.577046 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-514938dc-e5ad-43cc-acb1-cb66dd8ba684 req-70f62232-15ca-4083-a5b0-6cef5a85b870 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400872 Nov 18 18:22:27.544939 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8571eda-e396-4a95-8aeb-16ca022aac88 req-57be5453-f53a-4b51-9335-0f88c5f6cab7 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:27.546420 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a8571eda-e396-4a95-8aeb-16ca022aac88 req-57be5453-f53a-4b51-9335-0f88c5f6cab7 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 945 time: 0.0482769 Nov 18 18:22:27.602036 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a8571eda-e396-4a95-8aeb-16ca022aac88 req-62e17d16-0c49-4d96-b712-4aa746d75b2a tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497317 Nov 18 18:22:27.707857 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ed5ed6-da94-4eee-9f26-c33a350b7516 req-05f7dcbc-dfb0-495f-9fe3-fb159debd565 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:27.709363 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-63ed5ed6-da94-4eee-9f26-c33a350b7516 req-05f7dcbc-dfb0-495f-9fe3-fb159debd565 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0481315 Nov 18 18:22:27.762072 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-63ed5ed6-da94-4eee-9f26-c33a350b7516 req-dddd9ca8-0a6f-4720-90da-a9816a64e8a0 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463173 Nov 18 18:22:28.719128 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e78efb4a-c81e-457a-9239-4ed8e2810e5a req-08df837d-c54c-41af-a1f3-d494809e1a20 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:28.720581 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e78efb4a-c81e-457a-9239-4ed8e2810e5a req-08df837d-c54c-41af-a1f3-d494809e1a20 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 945 time: 0.0479529 Nov 18 18:22:28.767097 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e78efb4a-c81e-457a-9239-4ed8e2810e5a req-b9d412e4-abc7-4ae5-8439-6cc8ea3366fd tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401812 Nov 18 18:22:28.976170 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a802b948-f602-4ea1-baae-7ca37d86cef7 req-8a89017d-b101-4c88-afda-8db5abab806e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:28.977552 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a802b948-f602-4ea1-baae-7ca37d86cef7 req-8a89017d-b101-4c88-afda-8db5abab806e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0481436 Nov 18 18:22:29.024983 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a802b948-f602-4ea1-baae-7ca37d86cef7 req-f131630b-1bdc-44ff-a0e1-32f011315575 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414069 Nov 18 18:22:30.149703 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-370c6386-ae4e-478c-8cba-274843ac897b req-f9e51dcd-cc4e-4ba7-916b-ddc57d9a2b55 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:30.151180 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-370c6386-ae4e-478c-8cba-274843ac897b req-f9e51dcd-cc4e-4ba7-916b-ddc57d9a2b55 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0571971 Nov 18 18:22:30.197648 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-370c6386-ae4e-478c-8cba-274843ac897b req-9dde5c6c-4505-4c99-a44e-5eeea0c0d27b tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404541 Nov 18 18:22:31.312566 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340a6ea9-33cb-45e1-a8ca-9c73355bc154 req-454ecd4b-1afd-4a5b-b921-efb1b0adc218 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:31.314045 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-340a6ea9-33cb-45e1-a8ca-9c73355bc154 req-454ecd4b-1afd-4a5b-b921-efb1b0adc218 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0468779 Nov 18 18:22:31.359373 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-340a6ea9-33cb-45e1-a8ca-9c73355bc154 req-1210cda4-78c1-4b3b-a008-2735f704c580 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395572 Nov 18 18:22:33.979873 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-4079c882-e1c7-45ec-82dc-95ec563da050 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:36.420036 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-b69d1dbf-b80b-4f1d-a19d-ef5edc72a4bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:36.480228 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:22:37.692115 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:39.029403 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:40.171129 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:41.843701 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c78048-5709-4799-ba28-0764a426c941 req-16df2d8e-2784-487c-8e48-3d66276e8d9a tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:41.845194 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-16df2d8e-2784-487c-8e48-3d66276e8d9a tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/networks?id=f06fa801-dbf4-454b-984e-82c11cc6c900 HTTP/1.1" status: 200 len: 808 time: 0.1804330 Nov 18 18:22:41.867129 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-150e845e-6e60-45ac-aba0-ddccb66dc303 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:41.868588 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-150e845e-6e60-45ac-aba0-ddccb66dc303 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 815 time: 0.1847532 Nov 18 18:22:41.871963 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-0d050923-0956-46cb-b8e2-153f52b6ad2c tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/quotas/472f1c3f9a614eacab1165cd06691e36 HTTP/1.1" status: 200 len: 375 time: 0.0200651 Nov 18 18:22:41.892766 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-46b3c947-8470-4ffd-a2da-2f54adc7bc3f tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/quotas/eed6400cd0414bc5a520c9886c2a4bde HTTP/1.1" status: 200 len: 375 time: 0.0183740 Nov 18 18:22:41.908117 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-369166aa-331a-4800-95db-1dbf0cd4fff6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=472f1c3f9a614eacab1165cd06691e36&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0275130 Nov 18 18:22:42.194454 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-742df139-3ca4-4cab-bfae-12bfda3d1a7f tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2884555 Nov 18 18:22:42.244613 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-150d0628-964a-4d0d-8a76-a557f42fa2b3 service neutron] 10.222.0.82 "GET /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3289971 Nov 18 18:22:42.351828 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-c859b2dd-e637-4d41-b67c-42b6aebcc068 service neutron] 10.222.0.82 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1500416 Nov 18 18:22:42.392218 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-f231cfa1-954f-46c7-acc9-36f40a7e9ac0 service neutron] 10.222.0.82 "GET /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1225929 Nov 18 18:22:42.457801 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-27d93e83-2505-4edf-9f97-9a7e726b2226 service neutron] 10.222.0.82 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0999458 Nov 18 18:22:45.476994 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c0d37e0-f833-41ad-9b79-4bd218a1748d req-e8d3ce9a-1b8e-4ca8-b9b9-b6bb41af85e2 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 210 time: 0.0292051 Nov 18 18:22:45.493478 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b231115d-7937-442e-8225-8786b103f5b9 req-0498c51a-8233-4982-b65e-ae5a3dba3604 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:45.495030 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b231115d-7937-442e-8225-8786b103f5b9 req-0498c51a-8233-4982-b65e-ae5a3dba3604 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0727813 Nov 18 18:22:45.555418 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b231115d-7937-442e-8225-8786b103f5b9 req-a0c705e7-3550-4fea-be42-09d0a5b4b8d8 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525274 Nov 18 18:22:45.569835 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5f2b098e-460e-4cc9-9063-555bc7eeffa7 req-a5a89cb8-2d99-4fc6-9053-7ebcaa1e2e3e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 210 time: 0.0298347 Nov 18 18:22:48.994820 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-408f8858-5101-4653-95f6-51bbbf004ff9 req-27bb3245-aefa-4ea2-aa8f-c1c7baedfae2 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 210 time: 0.0480497 Nov 18 18:22:49.064830 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c78048-5709-4799-ba28-0764a426c941 req-34478f40-d77f-44cc-902c-98679a980400 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:49.066454 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-34478f40-d77f-44cc-902c-98679a980400 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.31 "GET /v2.0/networks?id=f06fa801-dbf4-454b-984e-82c11cc6c900 HTTP/1.1" status: 200 len: 808 time: 0.1113436 Nov 18 18:22:49.072806 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afddd10d-232b-4b34-8ae0-7b71bd609d3e req-8f952843-a1c1-40c9-a022-986e5c305696 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:49.075017 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-afddd10d-232b-4b34-8ae0-7b71bd609d3e req-8f952843-a1c1-40c9-a022-986e5c305696 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0793273 Nov 18 18:22:49.090843 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-96c78048-5709-4799-ba28-0764a426c941 req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Request body: {'port': {'device_id': 'd15848c0-18b6-4c3a-9c1d-603051aaff7c', 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900', 'admin_state_up': True, 'tenant_id': '472f1c3f9a614eacab1165cd06691e36'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:22:49.118895 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-03d36b19-1b5a-4558-ac78-ffd8e642b053 req-1b27bb61-68d5-4ab6-bbbd-bfeba6f29981 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 210 time: 0.0425956 Nov 18 18:22:49.146137 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-afddd10d-232b-4b34-8ae0-7b71bd609d3e req-569c7932-8cc6-407f-8c6a-17dfdc2be665 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599375 Nov 18 18:22:49.209041 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-96c78048-5709-4799-ba28-0764a426c941 req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Made reservation on behalf of 472f1c3f9a614eacab1165cd06691e36 for: {'port': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:22:49.213438 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-96c78048-5709-4799-ba28-0764a426c941 req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:49.334166 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [req-96c78048-5709-4799-ba28-0764a426c941 req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Allocated IP 172.20.0.12 (f06fa801-dbf4-454b-984e-82c11cc6c900/d477b94e-c409-446d-9434-db6811cbe863/5ea42e6d-325e-4393-9e89-5ff3a5637109) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:22:49.485192 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-96c78048-5709-4799-ba28-0764a426c941 req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:49.522257 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-96c78048-5709-4799-ba28-0764a426c941 req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:49.560493 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-96c78048-5709-4799-ba28-0764a426c941 req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Network f06fa801-dbf4-454b-984e-82c11cc6c900 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:22:49.563600 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [req-96c78048-5709-4799-ba28-0764a426c941 req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:22:49.566108 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-96c78048-5709-4799-ba28-0764a426c941 req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:22:49.572882 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c78048-5709-4799-ba28-0764a426c941 req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:49.574452 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-96c78048-5709-4799-ba28-0764a426c941 req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:49.600350 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5171716 Nov 18 18:22:49.601016 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-020f8749-408f-4175-a212-754ecad2e1d6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Pushing event updated for resources: {'Port': ['ID=5ea42e6d-325e-4393-9e89-5ff3a5637109,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:49.619903 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Request body: {'port': {'device_id': 'd15848c0-18b6-4c3a-9c1d-603051aaff7c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:22:49.681992 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:49.720774 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbd68333-c8f2-4ae2-a244-98f3b1d3c158 req-e2536194-d54f-4925-aa5a-c55f155f07dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:49.722386 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fbd68333-c8f2-4ae2-a244-98f3b1d3c158 req-e2536194-d54f-4925-aa5a-c55f155f07dc service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 1099 time: 0.1074564 Nov 18 18:22:49.779352 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-1a904e57-452e-438d-9ed4-7e4d3bf98d6b tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:49.781094 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-1a904e57-452e-438d-9ed4-7e4d3bf98d6b tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 815 time: 0.1423953 Nov 18 18:22:49.816552 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Request body: {'port': {'device_id': '93cf3d51-be0b-4879-8ba4-73c4b8762ca6', 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1', 'admin_state_up': True, 'tenant_id': 'eed6400cd0414bc5a520c9886c2a4bde'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:22:49.842278 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fbd68333-c8f2-4ae2-a244-98f3b1d3c158 req-7c09a2ef-18a7-4994-9cb1-21bf3f6b18fc service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991504 Nov 18 18:22:49.958165 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Made reservation on behalf of eed6400cd0414bc5a520c9886c2a4bde for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:22:49.963712 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:49.992185 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5ea42e6d-325e-4393-9e89-5ff3a5637109 {{(pid=102688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:22:50.000328 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:50.012661 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.provisioning_blocks [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Transition to ACTIVE for port object 5ea42e6d-325e-4393-9e89-5ff3a5637109 will not be triggered until provisioned by entity L2. {{(pid=102688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:22:50.017911 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:50.074773 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Pushing event updated for resources: {'Port': ['ID=5ea42e6d-325e-4393-9e89-5ff3a5637109,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:50.101937 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Allocated IP 172.20.0.3 (14ac84aa-8c04-4323-8592-aecfbb5a7fe1/488ef4e4-e6f9-414a-b93f-aabd7b232f9e/6c7a2d7a-25d2-4642-b407-868695446a27) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:22:50.328671 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Attempting to bind port 5ea42e6d-325e-4393-9e89-5ff3a5637109 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:22:50.329306 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Attempting to bind port 5ea42e6d-325e-4393-9e89-5ff3a5637109 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': 'd50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900'}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:22:50.329670 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Attempting to bind port 5ea42e6d-325e-4393-9e89-5ff3a5637109 on network f06fa801-dbf4-454b-984e-82c11cc6c900 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:22:50.334100 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Port 5ea42e6d-325e-4393-9e89-5ff3a5637109 on network f06fa801-dbf4-454b-984e-82c11cc6c900 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:22:50.334423 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Attempting to bind port 5ea42e6d-325e-4393-9e89-5ff3a5637109 on network f06fa801-dbf4-454b-984e-82c11cc6c900 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:22:50.341097 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 22, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:22:50.341434 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Checking segment: {'id': 'd50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:22:50.341822 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Bound using segment: {'id': 'd50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900'} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:22:50.342251 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Bound port: 5ea42e6d-325e-4393-9e89-5ff3a5637109, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900'}}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:22:50.342602 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:50.354104 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4263bb82-ef66-462b-a784-82ebc88c3467 req-f4419f53-480b-4711-aafd-d6da39b06d8b tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 210 time: 0.0647478 Nov 18 18:22:50.385381 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9299c29-33aa-47c3-8df4-0c6aa0eb695a req-af7522aa-7c84-4e86-880b-56de40c7eb71 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:50.386969 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c9299c29-33aa-47c3-8df4-0c6aa0eb695a req-af7522aa-7c84-4e86-880b-56de40c7eb71 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 944 time: 0.1399224 Nov 18 18:22:50.411305 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:50.421423 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] For port 5ea42e6d-325e-4393-9e89-5ff3a5637109, host hv-cinder-78776, cleared binding levels {{(pid=102688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:22:50.425006 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] For port 5ea42e6d-325e-4393-9e89-5ff3a5637109, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=5ea42e6d-325e-4393-9e89-5ff3a5637109,segment=NetworkSegment(d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20),segment_id=d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20)] {{(pid=102688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:22:50.431054 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:50.466412 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:50.467035 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:50.468446 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] 10.222.0.31 "PUT /v2.0/ports/5ea42e6d-325e-4393-9e89-5ff3a5637109 HTTP/1.1" status: 200 len: 1094 time: 0.8533046 Nov 18 18:22:50.468887 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd15848c0-18b6-4c3a-9c1d-603051aaff7c', 'tag': '5ea42e6d-325e-4393-9e89-5ff3a5637109'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:22:50.471683 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b87f471e-7a24-4259-b604-5b374ea4749d" -d '{"events": [{"name": "network-changed", "server_uuid": "d15848c0-18b6-4c3a-9c1d-603051aaff7c", "tag": "5ea42e6d-325e-4393-9e89-5ff3a5637109"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:22:50.490587 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c9299c29-33aa-47c3-8df4-0c6aa0eb695a req-d8f930b6-479c-40dc-9902-1140fdc5abcf tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0955472 Nov 18 18:22:50.497691 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e9130fc-559c-4eab-b4a7-ab7621bc8fb8 service neutron] Pushing event updated for resources: {'Port': ['ID=5ea42e6d-325e-4393-9e89-5ff3a5637109,revision_number=3']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:50.506018 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:50.526459 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['f3483de4-481b-47ac-8d51-f8457fd0bb85', '1b418eab-96c7-4da9-ba41-6e91026f7285'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:22:50.552685 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42b7bfa-1818-408c-809c-6100083b47f0 req-b9d3386e-5f04-4d08-a791-03202846b411 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:50.560580 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a42b7bfa-1818-408c-809c-6100083b47f0 req-b9d3386e-5f04-4d08-a791-03202846b411 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.1244075 Nov 18 18:22:50.571684 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:22:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5d15c401-046c-451d-94d4-0bd2f136fc0c x-openstack-request-id: req-5d15c401-046c-451d-94d4-0bd2f136fc0c {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:22:50.572076 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d15848c0-18b6-4c3a-9c1d-603051aaff7c", "tag": "5ea42e6d-325e-4393-9e89-5ff3a5637109", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:22:50.572430 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-5d15c401-046c-451d-94d4-0bd2f136fc0c {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:22:50.572869 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd15848c0-18b6-4c3a-9c1d-603051aaff7c', 'tag': '5ea42e6d-325e-4393-9e89-5ff3a5637109', 'status': 'completed', 'code': 200} Nov 18 18:22:50.579779 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c78048-5709-4799-ba28-0764a426c941 req-7462ae14-50d7-47f0-876f-9831ccd1429b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:50.581873 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-7462ae14-50d7-47f0-876f-9831ccd1429b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=472f1c3f9a614eacab1165cd06691e36&device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 1097 time: 0.0570652 Nov 18 18:22:50.599031 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:22:50.606508 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Pushing event updated for resources: {'Port': ['ID=6c7a2d7a-25d2-4642-b407-868695446a27,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:50.609031 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:22:50.613495 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:22:50.640817 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-7eaf9ec6-75e4-4dc0-be6a-6e0e9dbbba98 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=5ea42e6d-325e-4393-9e89-5ff3a5637109 HTTP/1.1" status: 200 len: 217 time: 0.0443068 Nov 18 18:22:50.672580 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a42b7bfa-1818-408c-809c-6100083b47f0 req-edeb91f1-4932-4c5e-a990-72e1e16fb381 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1109917 Nov 18 18:22:50.690254 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:50.691530 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:50.704399 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c78048-5709-4799-ba28-0764a426c941 req-ccc5ee93-7f0c-417e-a4ae-9fec68bea7bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:50.705840 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-ccc5ee93-7f0c-417e-a4ae-9fec68bea7bb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d477b94e-c409-446d-9434-db6811cbe863 HTTP/1.1" status: 200 len: 848 time: 0.0471997 Nov 18 18:22:50.709765 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3cdaef33-3587-4a6c-935a-eb09c62da6a1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9152505 Nov 18 18:22:50.747848 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Request body: {'port': {'device_id': '93cf3d51-be0b-4879-8ba4-73c4b8762ca6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:22:50.769792 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-5c67de27-7f50-42a8-b4d8-12af16d81334 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f06fa801-dbf4-454b-984e-82c11cc6c900&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0287645 Nov 18 18:22:50.809066 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:50.872457 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-d6c0f878-e237-4378-8efa-9a4776d02292 service neutron] 10.222.0.31 "GET /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0922303 Nov 18 18:22:50.969413 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-96c78048-5709-4799-ba28-0764a426c941 req-32f7e064-37b3-4bd3-b431-5f017858e5a9 service neutron] 10.222.0.31 "GET /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858166 Nov 18 18:22:50.988791 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:51.064365 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b87f471e-7a24-4259-b604-5b374ea4749d req-47459d62-0001-44a0-8ef1-24e80726ac2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:51.065835 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-b87f471e-7a24-4259-b604-5b374ea4749d req-47459d62-0001-44a0-8ef1-24e80726ac2b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=472f1c3f9a614eacab1165cd06691e36&device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 1097 time: 0.0395613 Nov 18 18:22:51.074718 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6c7a2d7a-25d2-4642-b407-868695446a27 {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:22:51.082247 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:51.095702 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Transition to ACTIVE for port object 6c7a2d7a-25d2-4642-b407-868695446a27 will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:22:51.099878 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:51.166871 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Pushing event updated for resources: {'Port': ['ID=6c7a2d7a-25d2-4642-b407-868695446a27,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:51.172918 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b87f471e-7a24-4259-b604-5b374ea4749d req-0adb9a9b-39e5-485e-9236-d1ad4ce7ad63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:51.174694 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-b87f471e-7a24-4259-b604-5b374ea4749d req-0adb9a9b-39e5-485e-9236-d1ad4ce7ad63 service neutron] 10.222.0.31 "GET /v2.0/networks?id=f06fa801-dbf4-454b-984e-82c11cc6c900 HTTP/1.1" status: 200 len: 910 time: 0.0961504 Nov 18 18:22:51.226364 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Attempting to bind port 6c7a2d7a-25d2-4642-b407-868695446a27 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:22:51.226771 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Attempting to bind port 6c7a2d7a-25d2-4642-b407-868695446a27 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:22:51.227285 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Attempting to bind port 6c7a2d7a-25d2-4642-b407-868695446a27 on network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:22:51.231781 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Port 6c7a2d7a-25d2-4642-b407-868695446a27 on network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:22:51.232198 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Attempting to bind port 6c7a2d7a-25d2-4642-b407-868695446a27 on network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:22:51.239174 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 22, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:22:51.239815 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Checking segment: {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:22:51.240155 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-b87f471e-7a24-4259-b604-5b374ea4749d req-4091f952-773e-4012-ac10-0a25b3113504 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=5ea42e6d-325e-4393-9e89-5ff3a5637109 HTTP/1.1" status: 200 len: 217 time: 0.0537753 Nov 18 18:22:51.240676 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Bound using segment: {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:22:51.241422 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Bound port: 6c7a2d7a-25d2-4642-b407-868695446a27, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:22:51.242000 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:51.297137 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b87f471e-7a24-4259-b604-5b374ea4749d req-7f10a4f4-920f-49f7-b868-785f02e24b92 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:51.298642 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-b87f471e-7a24-4259-b604-5b374ea4749d req-7f10a4f4-920f-49f7-b868-785f02e24b92 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d477b94e-c409-446d-9434-db6811cbe863 HTTP/1.1" status: 200 len: 848 time: 0.0453563 Nov 18 18:22:51.306185 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] For port 6c7a2d7a-25d2-4642-b407-868695446a27, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:22:51.309433 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] For port 6c7a2d7a-25d2-4642-b407-868695446a27, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c7a2d7a-25d2-4642-b407-868695446a27,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:22:51.314867 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:51.356674 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:51.357313 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:51.358746 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] 10.222.0.31 "PUT /v2.0/ports/6c7a2d7a-25d2-4642-b407-868695446a27 HTTP/1.1" status: 200 len: 1093 time: 0.6151710 Nov 18 18:22:51.359345 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '93cf3d51-be0b-4879-8ba4-73c4b8762ca6', 'tag': '6c7a2d7a-25d2-4642-b407-868695446a27'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:22:51.360734 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-b87f471e-7a24-4259-b604-5b374ea4749d req-4ab8d45c-8d8c-4cc2-a259-b62129109195 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f06fa801-dbf4-454b-984e-82c11cc6c900&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0343666 Nov 18 18:22:51.361918 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d64564a9-25bc-4222-952b-ba81a66aa1fe" -d '{"events": [{"name": "network-changed", "server_uuid": "93cf3d51-be0b-4879-8ba4-73c4b8762ca6", "tag": "6c7a2d7a-25d2-4642-b407-868695446a27"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:22:51.413090 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afb3d1be-0d15-4ad6-b9d7-7efbd450c469 service neutron] Pushing event updated for resources: {'Port': ['ID=6c7a2d7a-25d2-4642-b407-868695446a27,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:51.478885 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:22:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-61765af9-5da6-42a4-82e6-73c643b497f6 x-openstack-request-id: req-61765af9-5da6-42a4-82e6-73c643b497f6 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:22:51.479251 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "93cf3d51-be0b-4879-8ba4-73c4b8762ca6", "tag": "6c7a2d7a-25d2-4642-b407-868695446a27", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:22:51.479571 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-61765af9-5da6-42a4-82e6-73c643b497f6 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:22:51.480047 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '93cf3d51-be0b-4879-8ba4-73c4b8762ca6', 'tag': '6c7a2d7a-25d2-4642-b407-868695446a27', 'status': 'completed', 'code': 200} Nov 18 18:22:51.485620 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-b87f471e-7a24-4259-b604-5b374ea4749d req-3327221f-821a-4380-9ca7-f158fb192f5f service neutron] 10.222.0.31 "GET /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1080499 Nov 18 18:22:51.531988 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-b6f2576b-178c-4698-9a4f-a638b1adc708 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:51.533578 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-b6f2576b-178c-4698-9a4f-a638b1adc708 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 1096 time: 0.1064007 Nov 18 18:22:51.541123 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-302a97d3-927f-477a-a2f3-3c020eaecbd3 req-7906e297-3098-4ec4-9710-160992d13da1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:51.542572 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-302a97d3-927f-477a-a2f3-3c020eaecbd3 req-7906e297-3098-4ec4-9710-160992d13da1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 943 time: 0.0617282 Nov 18 18:22:51.600190 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-e775f472-80df-4e56-91f8-73340b1c2c2d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6c7a2d7a-25d2-4642-b407-868695446a27 HTTP/1.1" status: 200 len: 217 time: 0.0503981 Nov 18 18:22:51.612693 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-b87f471e-7a24-4259-b604-5b374ea4749d req-8ae8ae24-2272-49ff-a175-06f9fa4a9c30 service neutron] 10.222.0.31 "GET /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1098342 Nov 18 18:22:51.706015 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-302a97d3-927f-477a-a2f3-3c020eaecbd3 req-013d721f-93b4-4ae3-9565-6b3215709841 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1552374 Nov 18 18:22:51.713410 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3499738b-e984-4c60-b282-ad8cd08d3155 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:51.714870 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-3499738b-e984-4c60-b282-ad8cd08d3155 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=488ef4e4-e6f9-414a-b93f-aabd7b232f9e HTTP/1.1" status: 200 len: 855 time: 0.1045973 Nov 18 18:22:51.726945 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f61029c9-6ea5-4c29-94bb-e08dda534b08 req-7bd20f83-a7f4-4fac-accb-4e1b43bf053c tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:51.727833 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f61029c9-6ea5-4c29-94bb-e08dda534b08 req-7bd20f83-a7f4-4fac-accb-4e1b43bf053c tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 944 time: 0.1312668 Nov 18 18:22:51.778231 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-53e933be-b5d5-4557-853e-ed5ecdfe1e4e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0381508 Nov 18 18:22:51.858027 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f61029c9-6ea5-4c29-94bb-e08dda534b08 req-deab58dc-c4d3-4bfd-89a8-7fad2b12b374 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1240730 Nov 18 18:22:51.905128 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29929ae8-9b1e-4c17-b267-ef4e54636084 req-52c6fd1c-43fc-40b7-a506-c3f5c20449b8 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:51.906593 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-29929ae8-9b1e-4c17-b267-ef4e54636084 req-52c6fd1c-43fc-40b7-a506-c3f5c20449b8 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.1273985 Nov 18 18:22:51.941941 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-7a0a6f4d-652d-4b31-ab11-214c4500dcaa service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1305177 Nov 18 18:22:51.985009 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-29929ae8-9b1e-4c17-b267-ef4e54636084 req-5f3c1f9a-a5ef-484e-a8b5-ace075036ae3 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692494 Nov 18 18:22:52.052600 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c30073b-5fd7-4789-ab4e-7751ee1754e6 req-0bbab083-0a1a-4d33-a607-60e2102e7341 service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0900536 Nov 18 18:22:52.167460 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64564a9-25bc-4222-952b-ba81a66aa1fe req-e04faa18-105e-4306-b1b1-01826028ee41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:52.168884 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d64564a9-25bc-4222-952b-ba81a66aa1fe req-e04faa18-105e-4306-b1b1-01826028ee41 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 1096 time: 0.0394995 Nov 18 18:22:52.269751 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64564a9-25bc-4222-952b-ba81a66aa1fe req-4ac3a69f-bb14-48d9-a83b-4877bf979f1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:52.271189 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d64564a9-25bc-4222-952b-ba81a66aa1fe req-4ac3a69f-bb14-48d9-a83b-4877bf979f1d service neutron] 10.222.0.31 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 917 time: 0.0860376 Nov 18 18:22:52.313416 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d64564a9-25bc-4222-952b-ba81a66aa1fe req-fdbc9c79-2c7f-4971-b613-44026aa753c1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6c7a2d7a-25d2-4642-b407-868695446a27 HTTP/1.1" status: 200 len: 217 time: 0.0343192 Nov 18 18:22:52.363987 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64564a9-25bc-4222-952b-ba81a66aa1fe req-abf94ccb-0fdb-45e8-a610-3543e6ffeeec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:52.365457 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d64564a9-25bc-4222-952b-ba81a66aa1fe req-abf94ccb-0fdb-45e8-a610-3543e6ffeeec service neutron] 10.222.0.31 "GET /v2.0/subnets?id=488ef4e4-e6f9-414a-b93f-aabd7b232f9e HTTP/1.1" status: 200 len: 855 time: 0.0431321 Nov 18 18:22:52.398797 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d64564a9-25bc-4222-952b-ba81a66aa1fe req-7d4996ff-9bdb-4400-9f33-721a705881ad service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0237870 Nov 18 18:22:52.498534 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d64564a9-25bc-4222-952b-ba81a66aa1fe req-4f29c6d5-fda1-409b-a507-eb3abf62656a service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832379 Nov 18 18:22:52.593201 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d64564a9-25bc-4222-952b-ba81a66aa1fe req-fed417bc-39fd-4a90-b170-8bc6b9a328a8 service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825005 Nov 18 18:22:53.049477 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9303ac96-cbbf-4766-ba99-2719eb28b592 req-52226476-b326-462b-ab2a-756a0d0d280f tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:53.050957 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9303ac96-cbbf-4766-ba99-2719eb28b592 req-52226476-b326-462b-ab2a-756a0d0d280f tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 943 time: 0.2760108 Nov 18 18:22:53.062740 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca4ce0e-9b71-4554-8fbd-b3e072204078 req-b3ea13cd-33b0-4765-b03c-c5228b96c9d4 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:53.064297 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8ca4ce0e-9b71-4554-8fbd-b3e072204078 req-b3ea13cd-33b0-4765-b03c-c5228b96c9d4 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 944 time: 0.0659604 Nov 18 18:22:53.139073 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9303ac96-cbbf-4766-ba99-2719eb28b592 req-6ce779b4-0335-4926-a4ac-5c64eb72ca78 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737662 Nov 18 18:22:53.143351 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8ca4ce0e-9b71-4554-8fbd-b3e072204078 req-0fecbd30-4c52-48ed-affa-4b024f5f750c tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0718970 Nov 18 18:22:53.245222 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a3a2acd-6172-472b-9e20-b1cbd23bb82a req-9b0f29e6-58bd-480d-be82-5e4594b9aef8 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:53.246608 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a3a2acd-6172-472b-9e20-b1cbd23bb82a req-9b0f29e6-58bd-480d-be82-5e4594b9aef8 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0536339 Nov 18 18:22:53.293415 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a3a2acd-6172-472b-9e20-b1cbd23bb82a req-a4591272-42a5-4940-b112-539437770d63 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408268 Nov 18 18:22:53.405082 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6b9a7f7-b24a-47d1-9321-376db4162edd req-cd96567c-a6f5-4db9-a4bf-abc976f14109 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:53.406648 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b6b9a7f7-b24a-47d1-9321-376db4162edd req-cd96567c-a6f5-4db9-a4bf-abc976f14109 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0473299 Nov 18 18:22:53.454200 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b6b9a7f7-b24a-47d1-9321-376db4162edd req-63bda2d4-0a3a-41d8-b33d-99a138512f54 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418119 Nov 18 18:22:54.211312 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 6c7a2d7a-25d2-4642-b407-868695446a27 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:22:54.285441 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddfe870-ade1-4d12-a68c-af239114f24c req-9fa661a9-5a37-437e-8bae-6b6c2774745e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:54.286864 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dddfe870-ade1-4d12-a68c-af239114f24c req-9fa661a9-5a37-437e-8bae-6b6c2774745e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 943 time: 0.0787220 Nov 18 18:22:54.301794 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53f2e5c6-a89a-4cb0-8e55-65a22689dba8 req-7734da87-13f5-4a94-9c9d-ef2fc0b221f8 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:54.303432 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-53f2e5c6-a89a-4cb0-8e55-65a22689dba8 req-7734da87-13f5-4a94-9c9d-ef2fc0b221f8 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 944 time: 0.0665436 Nov 18 18:22:54.305725 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 6c7a2d7a-25d2-4642-b407-868695446a27, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c7a2d7a-25d2-4642-b407-868695446a27,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:22:54.317040 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '6c7a2d7a-25d2-4642-b407-868695446a27', 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1', 'port_id': '6c7a2d7a-25d2-4642-b407-868695446a27', 'mac_address': 'fa:16:3e:9c:c3:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1303, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '488ef4e4-e6f9-414a-b93f-aabd7b232f9e', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:22:54.358705 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:54.372480 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6c7a2d7a-25d2-4642-b407-868695446a27 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:22:54.374297 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dddfe870-ade1-4d12-a68c-af239114f24c req-65e13a3e-0368-404a-abc3-9988075a768d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0803165 Nov 18 18:22:54.377866 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-53f2e5c6-a89a-4cb0-8e55-65a22689dba8 req-274a6b63-5537-4b35-b03d-ecdafa2d8e49 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0678551 Nov 18 18:22:54.396097 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 6c7a2d7a-25d2-4642-b407-868695446a27, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c7a2d7a-25d2-4642-b407-868695446a27,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:22:54.400374 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:54.401052 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 5ea42e6d-325e-4393-9e89-5ff3a5637109 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:22:54.466899 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=6c7a2d7a-25d2-4642-b407-868695446a27,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:54.533460 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 5ea42e6d-325e-4393-9e89-5ff3a5637109, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=5ea42e6d-325e-4393-9e89-5ff3a5637109,segment=NetworkSegment(d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20),segment_id=d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:22:54.544542 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '5ea42e6d-325e-4393-9e89-5ff3a5637109', 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900', 'port_id': '5ea42e6d-325e-4393-9e89-5ff3a5637109', 'mac_address': 'fa:16:3e:9a:c9:7e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1333, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd477b94e-c409-446d-9434-db6811cbe863', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:22:54.580276 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:54.593635 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5ea42e6d-325e-4393-9e89-5ff3a5637109 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:22:54.615508 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 5ea42e6d-325e-4393-9e89-5ff3a5637109, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=5ea42e6d-325e-4393-9e89-5ff3a5637109,segment=NetworkSegment(d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20),segment_id=d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:22:54.620196 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:54.670104 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=5ea42e6d-325e-4393-9e89-5ff3a5637109,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:55.099158 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['6c7a2d7a-25d2-4642-b407-868695446a27'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:22:55.132984 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['5ea42e6d-325e-4393-9e89-5ff3a5637109'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:22:55.228265 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2821d1b-cd0f-4e95-9f0b-e6cfc7f985ff req-738ed805-0597-45b5-9aff-c34e68bebf13 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:55.229971 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c2821d1b-cd0f-4e95-9f0b-e6cfc7f985ff req-738ed805-0597-45b5-9aff-c34e68bebf13 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0846992 Nov 18 18:22:55.235635 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0a3ad99-abc0-4623-88d7-91db3d4c6b48 req-7a0fedd0-a7da-494d-b145-901c7ee5745d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:55.237212 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f0a3ad99-abc0-4623-88d7-91db3d4c6b48 req-7a0fedd0-a7da-494d-b145-901c7ee5745d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 1098 time: 0.0810871 Nov 18 18:22:55.341409 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c2821d1b-cd0f-4e95-9f0b-e6cfc7f985ff req-9d2ffb73-c78f-4fdd-ba13-a1d6de7fbdbb tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1017234 Nov 18 18:22:55.366403 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0a3ad99-abc0-4623-88d7-91db3d4c6b48 req-eef84ddd-b843-4c70-9c28-21517bc8fac9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:55.368710 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f0a3ad99-abc0-4623-88d7-91db3d4c6b48 req-eef84ddd-b843-4c70-9c28-21517bc8fac9 service neutron] 10.222.0.31 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 921 time: 0.1216249 Nov 18 18:22:55.436468 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f0a3ad99-abc0-4623-88d7-91db3d4c6b48 req-e89dba26-86fb-408c-84eb-405aa3b64147 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b627bee7-04b0-4a31-8ff0-84f976c65917 HTTP/1.1" status: 200 len: 217 time: 0.0472312 Nov 18 18:22:55.552065 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0a3ad99-abc0-4623-88d7-91db3d4c6b48 req-57fb31f2-23d0-48f3-906e-b2f38f5e5f26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:55.554067 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f0a3ad99-abc0-4623-88d7-91db3d4c6b48 req-57fb31f2-23d0-48f3-906e-b2f38f5e5f26 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 HTTP/1.1" status: 200 len: 859 time: 0.1074955 Nov 18 18:22:55.575806 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f78b2814-a8a0-4178-a8db-7d14528a6967 req-eada3a59-c4fa-476f-9b88-fa8b0844e8c9 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:55.577350 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f78b2814-a8a0-4178-a8db-7d14528a6967 req-eada3a59-c4fa-476f-9b88-fa8b0844e8c9 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 944 time: 0.1043534 Nov 18 18:22:55.594649 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e9088a-b483-4152-93cf-2f8ccaa92bd8 req-468dbfad-22eb-4b19-8d02-07183e16652a tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:55.598692 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65e9088a-b483-4152-93cf-2f8ccaa92bd8 req-468dbfad-22eb-4b19-8d02-07183e16652a tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 945 time: 0.1058650 Nov 18 18:22:55.624090 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f0a3ad99-abc0-4623-88d7-91db3d4c6b48 req-55859005-a951-493b-a13f-70a7d114ab75 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0568883 Nov 18 18:22:55.744822 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f78b2814-a8a0-4178-a8db-7d14528a6967 req-3615b598-3166-483b-b03e-1a194ac94c04 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1584082 Nov 18 18:22:55.753812 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65e9088a-b483-4152-93cf-2f8ccaa92bd8 req-c1ab657b-decf-418b-b4e3-390dabb9e713 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1318960 Nov 18 18:22:55.784546 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f0a3ad99-abc0-4623-88d7-91db3d4c6b48 req-ee9ac906-c9ff-4ea7-a847-d64f25a0b709 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1481009 Nov 18 18:22:55.885915 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f0a3ad99-abc0-4623-88d7-91db3d4c6b48 req-4f98ffb9-6b85-4528-bd50-a2f81f092dd5 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832188 Nov 18 18:22:56.477438 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b4f417-08dc-47cf-a724-3d91d4f7b89f req-a4a62f44-7478-42d5-8826-a73bce457d71 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:56.478926 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-68b4f417-08dc-47cf-a724-3d91d4f7b89f req-a4a62f44-7478-42d5-8826-a73bce457d71 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0531714 Nov 18 18:22:56.525971 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-68b4f417-08dc-47cf-a724-3d91d4f7b89f req-7bc15d86-1c64-40ab-bd88-ee98c9171e41 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411482 Nov 18 18:22:56.888732 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b112083a-4514-41ee-8b3a-e5e3ec29ef17 req-0c410925-5e42-4249-a675-b5ed69a44974 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:56.890677 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b112083a-4514-41ee-8b3a-e5e3ec29ef17 req-0c410925-5e42-4249-a675-b5ed69a44974 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 944 time: 0.0741470 Nov 18 18:22:56.901783 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79280783-ef2f-404c-b094-6f1004464d9d req-320265d3-9a5a-41be-aadf-b9b707882272 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:56.903292 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-79280783-ef2f-404c-b094-6f1004464d9d req-320265d3-9a5a-41be-aadf-b9b707882272 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 945 time: 0.0782545 Nov 18 18:22:56.979594 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b112083a-4514-41ee-8b3a-e5e3ec29ef17 req-141f31ca-f093-4ca7-9a1e-6a2939630545 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0754147 Nov 18 18:22:56.983949 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-79280783-ef2f-404c-b094-6f1004464d9d req-a2d5817e-4cfc-4ce5-b153-d5bd25974b3d tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732081 Nov 18 18:22:57.641441 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1aa21bb-bb66-43ce-8658-db61947a0339 req-f93d4c5f-0dac-4969-8f08-77857ae2d0d2 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:57.642905 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c1aa21bb-bb66-43ce-8658-db61947a0339 req-f93d4c5f-0dac-4969-8f08-77857ae2d0d2 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0471849 Nov 18 18:22:57.688495 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c1aa21bb-bb66-43ce-8658-db61947a0339 req-d5067ab1-9c9c-455a-ab0b-d8daca13e1ee tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393767 Nov 18 18:22:58.126863 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0567bb37-fb17-456d-a3f1-6ea37605f273 req-bd6caa9f-a1fb-45d3-a190-ddb513b24f54 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:58.128377 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0567bb37-fb17-456d-a3f1-6ea37605f273 req-bd6caa9f-a1fb-45d3-a190-ddb513b24f54 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 944 time: 0.0754218 Nov 18 18:22:58.140508 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c99cb44e-b6e2-4be9-b939-36d524778535 req-ddf4803e-9d3b-45e6-8d6e-3e80f1876dfd tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:22:58.141914 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c99cb44e-b6e2-4be9-b939-36d524778535 req-ddf4803e-9d3b-45e6-8d6e-3e80f1876dfd tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 945 time: 0.0800977 Nov 18 18:22:58.213221 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0567bb37-fb17-456d-a3f1-6ea37605f273 req-34ad9a73-1b78-485a-9a66-d7803291f519 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703659 Nov 18 18:22:58.221098 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c99cb44e-b6e2-4be9-b939-36d524778535 req-0c29550f-8c9d-4c6d-ac3c-cde1d611c52f tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677016 Nov 18 18:22:59.142738 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 5ea42e6d-325e-4393-9e89-5ff3a5637109 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:22:59.231569 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port 5ea42e6d-325e-4393-9e89-5ff3a5637109 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:22:59.244285 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 5ea42e6d-325e-4393-9e89-5ff3a5637109 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:22:59.244663 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:59.323391 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:59.345558 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd15848c0-18b6-4c3a-9c1d-603051aaff7c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5ea42e6d-325e-4393-9e89-5ff3a5637109'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:22:59.347766 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e0260847-a1f3-47d9-9647-624dcbc2c54f" -d '{"events": [{"server_uuid": "d15848c0-18b6-4c3a-9c1d-603051aaff7c", "name": "network-vif-plugged", "status": "completed", "tag": "5ea42e6d-325e-4393-9e89-5ff3a5637109"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:22:59.360611 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 5ea42e6d-325e-4393-9e89-5ff3a5637109, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=5ea42e6d-325e-4393-9e89-5ff3a5637109,segment=NetworkSegment(d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20),segment_id=d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:22:59.364612 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:59.365407 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 6c7a2d7a-25d2-4642-b407-868695446a27 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:22:59.546108 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=5ea42e6d-325e-4393-9e89-5ff3a5637109,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:22:59.558913 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port 6c7a2d7a-25d2-4642-b407-868695446a27 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:22:59.562805 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 6c7a2d7a-25d2-4642-b407-868695446a27 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:22:59.563174 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:59.636958 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:59.667957 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 6c7a2d7a-25d2-4642-b407-868695446a27, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c7a2d7a-25d2-4642-b407-868695446a27,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:22:59.671624 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:22:59.716921 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=6c7a2d7a-25d2-4642-b407-868695446a27,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:00.424478 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e045f375-e6af-4d17-88f4-f05f47e6b288 req-d5ea9059-4d5c-42dc-910f-7acfc807e35c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:00.425892 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e045f375-e6af-4d17-88f4-f05f47e6b288 req-d5ea9059-4d5c-42dc-910f-7acfc807e35c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0732744 Nov 18 18:23:00.446320 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a1a6615-b8a0-4544-aedf-eda0c5d6658c req-61ed5b1c-59a3-4d78-bbc0-239ec01e57c7 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:00.447723 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1a1a6615-b8a0-4544-aedf-eda0c5d6658c req-61ed5b1c-59a3-4d78-bbc0-239ec01e57c7 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 945 time: 0.0647829 Nov 18 18:23:00.516425 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e045f375-e6af-4d17-88f4-f05f47e6b288 req-6654215d-a7f5-4dd5-ba5f-3d43ce42fb83 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828996 Nov 18 18:23:00.521149 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1a1a6615-b8a0-4544-aedf-eda0c5d6658c req-cb8edfae-ad42-43bc-842c-18b4de6ca581 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662022 Nov 18 18:23:00.565287 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:22:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d675627c-09d2-445a-87ac-7cae418dc369 x-openstack-request-id: req-d675627c-09d2-445a-87ac-7cae418dc369 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:23:00.565800 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d15848c0-18b6-4c3a-9c1d-603051aaff7c", "name": "network-vif-plugged", "status": "completed", "tag": "5ea42e6d-325e-4393-9e89-5ff3a5637109", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:23:00.565913 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-d675627c-09d2-445a-87ac-7cae418dc369 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:23:00.566306 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd15848c0-18b6-4c3a-9c1d-603051aaff7c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5ea42e6d-325e-4393-9e89-5ff3a5637109', 'code': 200} Nov 18 18:23:00.625034 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9f01c8-3216-4462-8520-da1f609237a6 req-a8294ded-e640-44b9-9988-4d3e1d308414 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:00.626540 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ff9f01c8-3216-4462-8520-da1f609237a6 req-a8294ded-e640-44b9-9988-4d3e1d308414 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 946 time: 0.0487144 Nov 18 18:23:00.675832 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ff9f01c8-3216-4462-8520-da1f609237a6 req-0d6f778b-dae7-4781-987e-656da1ff2d56 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429013 Nov 18 18:23:00.765554 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37501466-9f09-4ad2-9557-92735356a927 req-9739ab4a-1120-4266-9631-baab745ecf92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:00.767089 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-37501466-9f09-4ad2-9557-92735356a927 req-9739ab4a-1120-4266-9631-baab745ecf92 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 1099 time: 0.0379467 Nov 18 18:23:00.826622 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-37501466-9f09-4ad2-9557-92735356a927 req-2cc72b4b-6d42-400f-9825-6a2c6149e36c service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418346 Nov 18 18:23:01.671502 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b38087e-65cb-4f1c-8627-905d4f6f9b06 req-368d5cce-2d15-4962-9704-af91be551e38 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:01.673025 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3b38087e-65cb-4f1c-8627-905d4f6f9b06 req-368d5cce-2d15-4962-9704-af91be551e38 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0860190 Nov 18 18:23:01.681914 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd02264-0aa1-47d9-9c2b-30a4256d9564 req-233e4e99-54ab-4339-9e55-d45a84a4b859 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:01.683419 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3fd02264-0aa1-47d9-9c2b-30a4256d9564 req-233e4e99-54ab-4339-9e55-d45a84a4b859 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 945 time: 0.0806284 Nov 18 18:23:01.753980 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3b38087e-65cb-4f1c-8627-905d4f6f9b06 req-1996163f-e700-4d96-b5cd-e70485f5f1fd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695744 Nov 18 18:23:01.758928 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3fd02264-0aa1-47d9-9c2b-30a4256d9564 req-0aadabdd-2852-4202-aa5e-40234e4afa6b tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688422 Nov 18 18:23:01.860723 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57227f6-c5e4-4ed4-91df-3a4fff05f79c req-331917d1-51ba-4859-a23f-c50b5c51c45b tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:01.862173 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b57227f6-c5e4-4ed4-91df-3a4fff05f79c req-331917d1-51ba-4859-a23f-c50b5c51c45b tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 946 time: 0.0525420 Nov 18 18:23:01.906903 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b57227f6-c5e4-4ed4-91df-3a4fff05f79c req-44c97afb-f5b8-44f4-8cec-67da38f577a5 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381610 Nov 18 18:23:02.567088 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '93cf3d51-be0b-4879-8ba4-73c4b8762ca6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c7a2d7a-25d2-4642-b407-868695446a27'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:23:02.570004 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-71ad10c6-5a80-417f-91aa-82288e17b9a0" -d '{"events": [{"server_uuid": "93cf3d51-be0b-4879-8ba4-73c4b8762ca6", "name": "network-vif-plugged", "status": "completed", "tag": "6c7a2d7a-25d2-4642-b407-868695446a27"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:23:03.981577 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1dde38e4-bc8e-420a-8cd7-cdeda3293217 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:05.037495 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:23:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-216db49e-2f2f-40ff-b4d2-ae7b25629c2a x-openstack-request-id: req-216db49e-2f2f-40ff-b4d2-ae7b25629c2a {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:23:05.038624 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "93cf3d51-be0b-4879-8ba4-73c4b8762ca6", "name": "network-vif-plugged", "status": "completed", "tag": "6c7a2d7a-25d2-4642-b407-868695446a27", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:23:05.038718 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-216db49e-2f2f-40ff-b4d2-ae7b25629c2a {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:23:05.039147 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '93cf3d51-be0b-4879-8ba4-73c4b8762ca6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c7a2d7a-25d2-4642-b407-868695446a27', 'code': 200} Nov 18 18:23:05.130532 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ea01af7-3c9d-436d-b060-27578372b2da req-da2b2085-e5ca-442d-b0ee-fc26b84eccaa tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:05.132115 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0ea01af7-3c9d-436d-b060-27578372b2da req-da2b2085-e5ca-442d-b0ee-fc26b84eccaa tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0515335 Nov 18 18:23:05.204128 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502ae0fd-3780-44e7-a8c0-245c5e3474c3 req-2518df61-303c-4787-9f10-4a3a99bd38fe tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:05.205616 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-502ae0fd-3780-44e7-a8c0-245c5e3474c3 req-2518df61-303c-4787-9f10-4a3a99bd38fe tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 945 time: 0.0726290 Nov 18 18:23:05.213840 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0ea01af7-3c9d-436d-b060-27578372b2da req-c5c213e1-6e7a-43ff-9c09-edb473d9b263 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717719 Nov 18 18:23:05.269333 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-502ae0fd-3780-44e7-a8c0-245c5e3474c3 req-c3d9719d-fbf4-46f3-93f3-97f47f445771 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545502 Nov 18 18:23:05.327467 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e83b30-1016-4f32-9d43-43cfd5248a98 req-a7412015-e96c-4d47-9b67-f37e1314bc01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:05.329160 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b6e83b30-1016-4f32-9d43-43cfd5248a98 req-a7412015-e96c-4d47-9b67-f37e1314bc01 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 1098 time: 0.0738673 Nov 18 18:23:05.342764 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e61a4d3e-a45b-4431-867d-1814784374f3 req-7c31d8ce-7dd2-47bf-9cf7-01aabe3ed02c tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:05.344392 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e61a4d3e-a45b-4431-867d-1814784374f3 req-7c31d8ce-7dd2-47bf-9cf7-01aabe3ed02c tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 946 time: 0.0611112 Nov 18 18:23:05.407667 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b6e83b30-1016-4f32-9d43-43cfd5248a98 req-f2cad4d9-b0ac-4b3e-90a6-99d7d838d60a service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622430 Nov 18 18:23:05.420524 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e61a4d3e-a45b-4431-867d-1814784374f3 req-aa685da4-ffa4-485b-b796-541f280097c1 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686295 Nov 18 18:23:06.050664 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 38470) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:06.163848 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d03c6bf1-c0d3-4720-9c90-b0789e617f84 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:06.249156 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d03c6bf1-c0d3-4720-9c90-b0789e617f84 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:06.253323 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d03c6bf1-c0d3-4720-9c90-b0789e617f84 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:06.300474 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-d03c6bf1-c0d3-4720-9c90-b0789e617f84 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=63d13c9de45b44a29353455886c6f1fb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2487245 Nov 18 18:23:06.302501 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d03c6bf1-c0d3-4720-9c90-b0789e617f84 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bfddc242-00ef-4c02-86ec-29413c86329e,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:06.303259 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38480) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:06.342411 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8664cdc7-4b1a-47bb-acf4-ad0c5dcc9ef2 req-328e57e5-0e0e-4de0-8126-7c0f8add3f46 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:06.343957 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8664cdc7-4b1a-47bb-acf4-ad0c5dcc9ef2 req-328e57e5-0e0e-4de0-8126-7c0f8add3f46 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0550630 Nov 18 18:23:06.366778 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdc54e57-68a5-4c0b-b40c-086d10851540 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:06.388195 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdc54e57-68a5-4c0b-b40c-086d10851540 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:06.420708 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-601903d1-70b1-43b7-b787-19ef5c3d4b5d req-fbd6ba32-f324-41ed-bbc6-08e66cf08544 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:06.422252 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-601903d1-70b1-43b7-b787-19ef5c3d4b5d req-fbd6ba32-f324-41ed-bbc6-08e66cf08544 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 945 time: 0.0751104 Nov 18 18:23:06.422858 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a817e179-e7f6-4724-ad3b-3793823fb6ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:06.427324 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8664cdc7-4b1a-47bb-acf4-ad0c5dcc9ef2 req-f00317e1-2582-447c-b25a-6648ad883558 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715475 Nov 18 18:23:06.446216 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdc54e57-68a5-4c0b-b40c-086d10851540 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:06.450038 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdc54e57-68a5-4c0b-b40c-086d10851540 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:06.451492 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-fdc54e57-68a5-4c0b-b40c-086d10851540 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bfddc242-00ef-4c02-86ec-29413c86329e HTTP/1.1" status: 204 len: 168 time: 0.1464221 Nov 18 18:23:06.460835 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdc54e57-68a5-4c0b-b40c-086d10851540 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bfddc242-00ef-4c02-86ec-29413c86329e,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:06.496465 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-601903d1-70b1-43b7-b787-19ef5c3d4b5d req-d868131d-dbef-4fb0-82df-8f681a4a0dae tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665958 Nov 18 18:23:06.569903 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c0a819-128c-4dcb-b63d-4ea911f2cdb7 req-f98c92a6-6bed-41e8-911b-b07c0ac97ff0 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:06.571400 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-45c0a819-128c-4dcb-b63d-4ea911f2cdb7 req-f98c92a6-6bed-41e8-911b-b07c0ac97ff0 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 946 time: 0.0491652 Nov 18 18:23:06.619718 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-45c0a819-128c-4dcb-b63d-4ea911f2cdb7 req-7fb6206e-de76-46fa-959b-f083a32b7b20 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419214 Nov 18 18:23:07.401262 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38560) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:07.545796 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-60882709-bbb0-44c0-858a-e59a5ad9eb46 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:07.602497 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c95ad4a-f840-49ca-ab4a-c0a8919db340 req-e9c634ca-fdcc-4335-b327-07cb64196e2c tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:07.615310 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3c95ad4a-f840-49ca-ab4a-c0a8919db340 req-e9c634ca-fdcc-4335-b327-07cb64196e2c tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 946 time: 0.1528141 Nov 18 18:23:07.666196 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-60882709-bbb0-44c0-858a-e59a5ad9eb46 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:07.670331 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-60882709-bbb0-44c0-858a-e59a5ad9eb46 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:07.701689 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60882709-bbb0-44c0-858a-e59a5ad9eb46 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=403626f7-ad85-437c-b25c-701e03ac1efe,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:07.717939 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3c95ad4a-f840-49ca-ab4a-c0a8919db340 req-81bde54e-19fa-4a55-95bd-e42d0cab15bd tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918975 Nov 18 18:23:07.719428 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-60882709-bbb0-44c0-858a-e59a5ad9eb46 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=308bda6a54254df882283028ea507c43&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3161237 Nov 18 18:23:07.719570 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 38572) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:07.719956 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:07.733905 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa7390ba-6650-4e98-b4f0-c712a3fc2685 req-9c2a69d9-18e9-4aae-8b5b-1ca803b3fe8f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:07.735435 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fa7390ba-6650-4e98-b4f0-c712a3fc2685 req-9c2a69d9-18e9-4aae-8b5b-1ca803b3fe8f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1117048 Nov 18 18:23:07.841471 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fa7390ba-6650-4e98-b4f0-c712a3fc2685 req-c2f27378-e298-477c-9dcd-8944b2b96e26 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0962920 Nov 18 18:23:07.849600 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1e55a2ac-2218-4d9f-9b8d-24a011e611d5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:07.867965 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d69010c5-2e28-46f8-bd11-9bb86150c762 req-ea89259b-3f8f-44aa-87c5-e05982bb5ebd tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:07.869468 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d69010c5-2e28-46f8-bd11-9bb86150c762 req-ea89259b-3f8f-44aa-87c5-e05982bb5ebd tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 945 time: 0.0916390 Nov 18 18:23:07.900220 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1e55a2ac-2218-4d9f-9b8d-24a011e611d5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:07.953713 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d69010c5-2e28-46f8-bd11-9bb86150c762 req-244879f9-000d-4c83-a797-2f9c4de9ef41 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768967 Nov 18 18:23:07.976939 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1e55a2ac-2218-4d9f-9b8d-24a011e611d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:07.976939 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1e55a2ac-2218-4d9f-9b8d-24a011e611d5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:07.976939 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-1e55a2ac-2218-4d9f-9b8d-24a011e611d5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/403626f7-ad85-437c-b25c-701e03ac1efe HTTP/1.1" status: 204 len: 168 time: 0.2563074 Nov 18 18:23:07.984736 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e55a2ac-2218-4d9f-9b8d-24a011e611d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=403626f7-ad85-437c-b25c-701e03ac1efe,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:08.273797 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 38590) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:08.286946 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5582e77f-881f-4475-bc5f-e68a87dd6a8e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:08.361555 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5582e77f-881f-4475-bc5f-e68a87dd6a8e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:08.365198 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5582e77f-881f-4475-bc5f-e68a87dd6a8e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:08.404165 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-5582e77f-881f-4475-bc5f-e68a87dd6a8e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=460f7886e31448e5b0b2c6ef0c3ceb84&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1292868 Nov 18 18:23:08.405246 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5582e77f-881f-4475-bc5f-e68a87dd6a8e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4382ebf5-5793-4ce6-8e61-c190b5bea72f,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:08.406985 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38594) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:08.464548 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6cbfe503-a790-4423-805c-4875280ea78c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:08.484747 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6cbfe503-a790-4423-805c-4875280ea78c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:08.529833 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6cbfe503-a790-4423-805c-4875280ea78c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:08.532616 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6cbfe503-a790-4423-805c-4875280ea78c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:08.533747 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-6cbfe503-a790-4423-805c-4875280ea78c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4382ebf5-5793-4ce6-8e61-c190b5bea72f HTTP/1.1" status: 204 len: 168 time: 0.1257300 Nov 18 18:23:08.541790 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cbfe503-a790-4423-805c-4875280ea78c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4382ebf5-5793-4ce6-8e61-c190b5bea72f,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:08.848191 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0d3cdcf-fb47-4519-8297-4b7aedf31ea1 req-d1ac4ef6-6744-4d36-9ac6-24f11d404513 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:08.849692 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e0d3cdcf-fb47-4519-8297-4b7aedf31ea1 req-d1ac4ef6-6744-4d36-9ac6-24f11d404513 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 946 time: 0.0555353 Nov 18 18:23:08.899101 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e0d3cdcf-fb47-4519-8297-4b7aedf31ea1 req-b0dfe50d-0660-4e34-a8b5-55ec4063bbf3 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424194 Nov 18 18:23:08.974025 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7799167-4d8f-44e4-92d5-0a121abce1a3 req-defd5b6d-2aa8-46dc-b529-ae075f1aeb69 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:08.976151 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b7799167-4d8f-44e4-92d5-0a121abce1a3 req-defd5b6d-2aa8-46dc-b529-ae075f1aeb69 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0526304 Nov 18 18:23:09.033309 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b7799167-4d8f-44e4-92d5-0a121abce1a3 req-c7cf4496-b18e-4b7c-bc46-9f42f11c8f5c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508316 Nov 18 18:23:09.035573 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.051197 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cb5dc4f-166c-422d-bd69-29fac4f0d5c4 req-3faab83a-93be-45ca-bf46-7dfa39957609 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:10.053611 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9cb5dc4f-166c-422d-bd69-29fac4f0d5c4 req-3faab83a-93be-45ca-bf46-7dfa39957609 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 946 time: 0.0500467 Nov 18 18:23:10.106140 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38688) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:10.172702 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9cb5dc4f-166c-422d-bd69-29fac4f0d5c4 req-260fb34d-189e-4f6f-8ad7-8f625c6b69fa tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1110401 Nov 18 18:23:10.179587 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.205429 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73d1482-95f8-457b-a7f5-97c0d851a4da req-7d1d72a0-dfb1-4412-928e-c6d7b9ab071d tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:10.206920 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a73d1482-95f8-457b-a7f5-97c0d851a4da req-7d1d72a0-dfb1-4412-928e-c6d7b9ab071d tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.31 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 946 time: 0.1288810 Nov 18 18:23:10.238565 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea49982-4834-475d-a4db-e7d8e232fec5 req-820b3944-1b25-4056-bf03-8bba10ba9fcd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:10.240377 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aea49982-4834-475d-a4db-e7d8e232fec5 req-820b3944-1b25-4056-bf03-8bba10ba9fcd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0933292 Nov 18 18:23:10.354847 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38696) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:10.377149 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aea49982-4834-475d-a4db-e7d8e232fec5 req-a6ee8e2e-fcda-4292-a2af-57ecd173b047 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1099648 Nov 18 18:23:10.390196 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 38700) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:10.394575 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c9d8ce37-3a2e-47f6-b731-ed284d06b747 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.422377 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-a73d1482-95f8-457b-a7f5-97c0d851a4da req-8afb2d27-f305-4690-b4c4-f7e767be29c7 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Deleting port 5ea42e6d-325e-4393-9e89-5ff3a5637109 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:23:10.422714 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-a73d1482-95f8-457b-a7f5-97c0d851a4da req-8afb2d27-f305-4690-b4c4-f7e767be29c7 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.433457 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a8e0a006-aa5e-4a84-ae50-ea9166622859 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.492047 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-566230d7-453d-49a0-99f2-16682aedc55b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.531868 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c9d8ce37-3a2e-47f6-b731-ed284d06b747 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.542552 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c9d8ce37-3a2e-47f6-b731-ed284d06b747 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.547183 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-a73d1482-95f8-457b-a7f5-97c0d851a4da req-8afb2d27-f305-4690-b4c4-f7e767be29c7 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] For port 5ea42e6d-325e-4393-9e89-5ff3a5637109, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=5ea42e6d-325e-4393-9e89-5ff3a5637109,segment=NetworkSegment(d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20),segment_id=d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:10.547541 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-a73d1482-95f8-457b-a7f5-97c0d851a4da req-8afb2d27-f305-4690-b4c4-f7e767be29c7 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.567951 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-a73d1482-95f8-457b-a7f5-97c0d851a4da req-8afb2d27-f305-4690-b4c4-f7e767be29c7 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Calling delete_port for 5ea42e6d-325e-4393-9e89-5ff3a5637109 owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:23:10.576959 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a8e0a006-aa5e-4a84-ae50-ea9166622859 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.594958 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a8e0a006-aa5e-4a84-ae50-ea9166622859 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.604589 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9d8ce37-3a2e-47f6-b731-ed284d06b747 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a665f6b5-3af9-461d-b3e0-629382993f6a,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:10.610398 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-c9d8ce37-3a2e-47f6-b731-ed284d06b747 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3b0d855652c04cf1b9c083a77854c5c3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5022359 Nov 18 18:23:10.615117 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 38704) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:10.632364 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a8e0a006-aa5e-4a84-ae50-ea9166622859 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5b45696aeba842d186c32f57559c0795&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2756240 Nov 18 18:23:10.635551 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38710) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:10.656938 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e0a006-aa5e-4a84-ae50-ea9166622859 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a787921e-ba57-4316-84b4-9a93ebd177a5,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:10.700105 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.713088 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-566230d7-453d-49a0-99f2-16682aedc55b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.728061 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.728358 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-566230d7-453d-49a0-99f2-16682aedc55b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.780574 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.783133 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.784378 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a787921e-ba57-4316-84b4-9a93ebd177a5 HTTP/1.1" status: 204 len: 168 time: 0.1476464 Nov 18 18:23:10.789946 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-566230d7-453d-49a0-99f2-16682aedc55b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed581f6e-8352-4d7f-b99e-cb2d90ecd8b9,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:10.793294 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a787921e-ba57-4316-84b4-9a93ebd177a5,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:10.801670 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-566230d7-453d-49a0-99f2-16682aedc55b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=225adae9655e46de8660a7b2de505614&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4081342 Nov 18 18:23:10.802082 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:10.802082 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:10.802082 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:10.802082 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:10.802082 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:10.802454 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:10.802536 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:10.802827 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:10.803160 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:10.804081 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:10.804409 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:10.804744 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b04470fd-b50d-43b9-8315-5b23e9f1d228 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:10.807079 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38714) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:10.814964 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-eea041fd-e646-4e7d-b8e2-7809f633a130 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.875188 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-eea041fd-e646-4e7d-b8e2-7809f633a130 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.881903 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fe8d4f29-6109-476c-bffa-8cfff7ac0e6a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.904056 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fe8d4f29-6109-476c-bffa-8cfff7ac0e6a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.909281 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-a73d1482-95f8-457b-a7f5-97c0d851a4da req-8afb2d27-f305-4690-b4c4-f7e767be29c7 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.925925 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['5ea42e6d-325e-4393-9e89-5ff3a5637109'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:23:10.956807 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fe8d4f29-6109-476c-bffa-8cfff7ac0e6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.961024 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fe8d4f29-6109-476c-bffa-8cfff7ac0e6a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:10.962503 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-fe8d4f29-6109-476c-bffa-8cfff7ac0e6a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ed581f6e-8352-4d7f-b99e-cb2d90ecd8b9 HTTP/1.1" status: 204 len: 168 time: 0.1542201 Nov 18 18:23:10.971337 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe8d4f29-6109-476c-bffa-8cfff7ac0e6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed581f6e-8352-4d7f-b99e-cb2d90ecd8b9,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:11.156399 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38724) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:11.156974 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8afb2d27-f305-4690-b4c4-f7e767be29c7 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Pushing event deleted for resources: {'Port': ['ID=5ea42e6d-325e-4393-9e89-5ff3a5637109,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:11.178597 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-702c9bca-4471-492c-a276-7ff813e7673a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:11.222287 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-a73d1482-95f8-457b-a7f5-97c0d851a4da req-8afb2d27-f305-4690-b4c4-f7e767be29c7 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] No DVR routers for this DVR port 5ea42e6d-325e-4393-9e89-5ff3a5637109 on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:23:11.227066 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-a73d1482-95f8-457b-a7f5-97c0d851a4da req-8afb2d27-f305-4690-b4c4-f7e767be29c7 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:11.231388 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a73d1482-95f8-457b-a7f5-97c0d851a4da req-8afb2d27-f305-4690-b4c4-f7e767be29c7 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.31 "DELETE /v2.0/ports/5ea42e6d-325e-4393-9e89-5ff3a5637109 HTTP/1.1" status: 204 len: 173 time: 1.0065219 Nov 18 18:23:11.233358 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd15848c0-18b6-4c3a-9c1d-603051aaff7c', 'name': 'network-vif-deleted', 'tag': '5ea42e6d-325e-4393-9e89-5ff3a5637109'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:23:11.235880 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36fe6ca5-30b8-4916-802e-af2f9e28f5d0" -d '{"events": [{"server_uuid": "d15848c0-18b6-4c3a-9c1d-603051aaff7c", "name": "network-vif-deleted", "tag": "5ea42e6d-325e-4393-9e89-5ff3a5637109"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:23:11.252504 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-eea041fd-e646-4e7d-b8e2-7809f633a130 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:11.263409 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-eea041fd-e646-4e7d-b8e2-7809f633a130 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:11.275446 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-702c9bca-4471-492c-a276-7ff813e7673a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:11.275841 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-eea041fd-e646-4e7d-b8e2-7809f633a130 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a665f6b5-3af9-461d-b3e0-629382993f6a HTTP/1.1" status: 204 len: 168 time: 0.6587570 Nov 18 18:23:11.283078 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-702c9bca-4471-492c-a276-7ff813e7673a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:11.292552 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:23:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e325c04-a11f-4a65-a5b6-12382f7f1211 x-openstack-request-id: req-4e325c04-a11f-4a65-a5b6-12382f7f1211 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:23:11.292847 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d15848c0-18b6-4c3a-9c1d-603051aaff7c", "name": "network-vif-deleted", "tag": "5ea42e6d-325e-4393-9e89-5ff3a5637109", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:23:11.297124 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-4e325c04-a11f-4a65-a5b6-12382f7f1211 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:23:11.298681 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd15848c0-18b6-4c3a-9c1d-603051aaff7c', 'name': 'network-vif-deleted', 'tag': '5ea42e6d-325e-4393-9e89-5ff3a5637109', 'status': 'completed', 'code': 200} Nov 18 18:23:11.300419 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eea041fd-e646-4e7d-b8e2-7809f633a130 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a665f6b5-3af9-461d-b3e0-629382993f6a,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:11.339563 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-702c9bca-4471-492c-a276-7ff813e7673a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c75635bcd5da4bcfa604cf89a24ab3c9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1823764 Nov 18 18:23:11.340786 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-702c9bca-4471-492c-a276-7ff813e7673a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a15348b-2105-44c5-b92b-ff1eade0ce4d,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:11.343610 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38734) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:11.379809 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-48bc7cf8-db31-4815-aea2-55cf98f9f9a2 req-59102f53-4769-4e59-92e5-3494946bce38 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=d15848c0-18b6-4c3a-9c1d-603051aaff7c HTTP/1.1" status: 200 len: 210 time: 0.0476673 Nov 18 18:23:11.404215 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dddad362-77b1-4ab2-91fd-adea0879f0e3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:11.434034 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dddad362-77b1-4ab2-91fd-adea0879f0e3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:11.513396 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dddad362-77b1-4ab2-91fd-adea0879f0e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:11.518652 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dddad362-77b1-4ab2-91fd-adea0879f0e3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:11.521223 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-dddad362-77b1-4ab2-91fd-adea0879f0e3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4a15348b-2105-44c5-b92b-ff1eade0ce4d HTTP/1.1" status: 204 len: 168 time: 0.1759253 Nov 18 18:23:11.539193 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dddad362-77b1-4ab2-91fd-adea0879f0e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a15348b-2105-44c5-b92b-ff1eade0ce4d,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:11.554548 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc3a4435-a268-41d0-b9e7-f0a2a7ff2b87 req-30bcb561-2df9-486c-82cf-b93a3ddc7018 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:11.566845 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc3a4435-a268-41d0-b9e7-f0a2a7ff2b87 req-30bcb561-2df9-486c-82cf-b93a3ddc7018 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0970426 Nov 18 18:23:11.640492 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc3a4435-a268-41d0-b9e7-f0a2a7ff2b87 req-03c18d2b-2741-4fff-8374-6c563cb90100 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724709 Nov 18 18:23:12.365320 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38796) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:12.471612 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-40725722-network', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:12.505756 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Made reservation on behalf of 029e580af1e3498aa00c86f5ce660a80 for: {'network': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:23:12.508212 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:12.526677 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:12.629440 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:12.639481 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:12.666453 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1345} {{(pid=102688) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:23:12.691388 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:12.691684 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.segments_db [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Added segment 0bd6ae3c-7404-429f-9807-6c61fe30f185 of type vlan for network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a Nov 18 18:23:12.703126 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5557e29b-5cf1-496c-aaf9-7966b2aa28c3,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:12.745472 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:12.776542 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:12.777814 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:12.778852 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:12.824556 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.4574766 Nov 18 18:23:12.827520 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38834) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:12.867843 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-77544be2-861a-411c-9f03-b35f635122a6 admin admin] Request body: {'subnet': {'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-40725722-subnet', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'ip_version': 4}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:12.872099 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd603a17-7f25-4285-b56c-02b40db3ee5c admin admin] Pushing event updated for resources: {'Network': ['ID=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:12.880888 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-0dc75219-c157-45ec-94f4-0cb09b040c52 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:12.885005 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:23:12.889217 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-0dc75219-c157-45ec-94f4-0cb09b040c52 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/networks?id=f06fa801-dbf4-454b-984e-82c11cc6c900 HTTP/1.1" status: 200 len: 808 time: 0.2362902 Nov 18 18:23:12.910296 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ebf4fcd5-d5c4-4b54-aa2f-9b161ef3af7c tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/quotas/472f1c3f9a614eacab1165cd06691e36 HTTP/1.1" status: 200 len: 375 time: 0.0201521 Nov 18 18:23:12.933043 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-77544be2-861a-411c-9f03-b35f635122a6 admin admin] Made reservation on behalf of 029e580af1e3498aa00c86f5ce660a80 for: {'subnet': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:23:12.935594 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-77544be2-861a-411c-9f03-b35f635122a6 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:12.949407 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-c7462e6e-2e83-40f3-982a-76efcfe79253 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=472f1c3f9a614eacab1165cd06691e36&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0378454 Nov 18 18:23:12.965417 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5370c1cd-8d12-4a7e-abdf-6c2eda2c7766 req-2bd4c3d7-bdee-44c9-9ed0-428ff27a0bdf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:12.972652 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5370c1cd-8d12-4a7e-abdf-6c2eda2c7766 req-2bd4c3d7-bdee-44c9-9ed0-428ff27a0bdf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1541500 Nov 18 18:23:13.115714 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5370c1cd-8d12-4a7e-abdf-6c2eda2c7766 req-e555fe9c-c246-43dd-a947-1cea148bfa9a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1420896 Nov 18 18:23:13.146256 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-3321db06-9cf3-4ea0-8e29-972fefcdda08 service neutron] 10.222.0.82 "GET /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1959486 Nov 18 18:23:13.196519 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-77544be2-861a-411c-9f03-b35f635122a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:13.243713 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-dfd8cd19-82f8-49a2-9793-0028bc31d262 service neutron] 10.222.0.82 "GET /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880988 Nov 18 18:23:13.268904 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77544be2-861a-411c-9f03-b35f635122a6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cac1be0a-3676-49bd-8292-3623cc0fc8b1,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:13.271122 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77544be2-861a-411c-9f03-b35f635122a6 admin admin] Checking segment: {'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:13.271508 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77544be2-861a-411c-9f03-b35f635122a6 admin admin] Network hostable DHCP agents. Network: 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102688) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:23:13.292712 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77544be2-861a-411c-9f03-b35f635122a6 admin admin] Network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102688) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:23:13.306086 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-77544be2-861a-411c-9f03-b35f635122a6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a) {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:13.316816 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6f7f7d3-788a-4e16-a5dd-689ef7251cd1 None None] Network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:23:13.323856 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77544be2-861a-411c-9f03-b35f635122a6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:13.324628 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-77544be2-861a-411c-9f03-b35f635122a6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:13.343717 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-77544be2-861a-411c-9f03-b35f635122a6 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 843 time: 0.5147164 Nov 18 18:23:13.346802 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38856) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:13.354585 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:13.385906 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-430558', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-543'] for router, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:13.386923 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-430410', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-500004', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1631324', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-534'] for router, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:13.479627 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:23:13.484746 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:13.498420 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c2a67a9f-6c41-4a89-ab44-6d9dca149683 req-bffa63fe-1d44-48ec-b35b-0048e8cb95bf tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 210 time: 0.0512474 Nov 18 18:23:13.551527 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc1c763e3-2102-51f8-97fe-c751e57774c1-584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'fixed_ips': [{'subnet_id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1'}]}} from dv-cinder-787764-6-iscsi. {{(pid=102690) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 18:23:13.552874 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:13.658193 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:13.721472 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.db_base_plugin_common [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Allocated IP 172.20.0.2 (584f2b3a-f3ea-4f7c-bcc9-711159cffa8a/cac1be0a-3676-49bd-8292-3623cc0fc8b1/23520980-2021-4b45-9862-72ac55d89059) {{(pid=102690) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:13.903473 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Publish callbacks [] for port, precommit_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:13.904116 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:13.911902 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:13.926944 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:13.965907 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a is already hosted by enough agents. {{(pid=102690) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:13.974465 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.base_scheduler [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Resources bound (agent type, host, resource id): {{(pid=102690) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:13.976940 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Pushing event updated for resources: {'Port': ['ID=23520980-2021-4b45-9862-72ac55d89059,revision_number=1']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:13.979283 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Received port after_create {{(pid=102690) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:14.034856 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Attempting to bind port 23520980-2021-4b45-9862-72ac55d89059 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:14.035237 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Attempting to bind port 23520980-2021-4b45-9862-72ac55d89059 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:14.035612 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Attempting to bind port 23520980-2021-4b45-9862-72ac55d89059 on network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:14.043731 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:14.044164 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Checking segment: {'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:14.044720 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:14.045273 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Bound using segment: {'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:14.045760 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Bound port: 23520980-2021-4b45-9862-72ac55d89059, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:14.046147 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:14.070625 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Allocated IP 172.27.1.121 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:14.140475 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] For port 23520980-2021-4b45-9862-72ac55d89059, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:14.145396 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] For port 23520980-2021-4b45-9862-72ac55d89059, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=23520980-2021-4b45-9862-72ac55d89059,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:14.152126 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:14.211827 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:14.281976 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03a9a980-ce63-46ab-8473-ba3417cefa76 None None] Pushing event updated for resources: {'Port': ['ID=23520980-2021-4b45-9862-72ac55d89059,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:14.317236 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 5ea42e6d-325e-4393-9e89-5ff3a5637109 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:23:14.318122 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0f10ea1-ae11-40b6-bed9-9411ebdc18f5 req-7c285c6b-d3b7-49b9-9854-1eb315414d15 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:14.323963 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e0f10ea1-ae11-40b6-bed9-9411ebdc18f5 req-7c285c6b-d3b7-49b9-9854-1eb315414d15 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1083660 Nov 18 18:23:14.327437 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:14.352092 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: 5ea42e6d-325e-4393-9e89-5ff3a5637109 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:23:14.352369 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 5ea42e6d-325e-4393-9e89-5ff3a5637109 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:23:14.418272 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:14.432384 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:14.447513 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e0f10ea1-ae11-40b6-bed9-9411ebdc18f5 req-aaa65951-9b0c-4360-a3c6-55173a7341bc tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1149857 Nov 18 18:23:14.448484 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:14.520360 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Pushing event updated for resources: {'Port': ['ID=70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:14.656137 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7fead67e-7b7a-4aa3-87e6-d092164ec952 req-788f70a4-19cb-4d35-ab48-6972e489adda tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 210 time: 0.0779581 Nov 18 18:23:14.771313 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:14.840321 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-451499eb-901b-45f8-b4d6-56725c1ef42a tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:14.842117 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-451499eb-901b-45f8-b4d6-56725c1ef42a tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.31 "GET /v2.0/networks?id=f06fa801-dbf4-454b-984e-82c11cc6c900 HTTP/1.1" status: 200 len: 808 time: 0.1187339 Nov 18 18:23:14.971333 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-430421', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-500439'] for router, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:15.285646 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Router 0f9804e2-48c3-4648-b16c-33eeec3a9305 is scheduled to L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 with binding_index 1 {{(pid=102688) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 18:23:15.317679 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de2f3748-0d4e-4af8-9a2c-a0ffeec3625d None None] Network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:23:15.391572 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:23:15.400837 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Sync routers for ids ['0f9804e2-48c3-4648-b16c-33eeec3a9305'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:23:15.406696 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-8dce422b-81ca-4647-a239-325a29df1482 None None] Provisioning complete for port 23520980-2021-4b45-9862-72ac55d89059 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:15.407670 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-8dce422b-81ca-4647-a239-325a29df1482 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:15.409912 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] Publish callbacks [] for router, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:15.410742 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Routers {'0f9804e2-48c3-4648-b16c-33eeec3a9305'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:15.414498 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-f860eb03-c9bc-447d-a4bf-9ba5b0e7bcc2 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.0631087 Nov 18 18:23:15.414606 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['0f9804e2-48c3-4648-b16c-33eeec3a9305'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:15.414717 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 38902) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:15.544732 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Set router 0f9804e2-48c3-4648-b16c-33eeec3a9305 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:15.581582 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-8dce422b-81ca-4647-a239-325a29df1482 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:15.620504 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-8dce422b-81ca-4647-a239-325a29df1482 None None] For port 23520980-2021-4b45-9862-72ac55d89059, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=23520980-2021-4b45-9862-72ac55d89059,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:15.629247 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-8dce422b-81ca-4647-a239-325a29df1482 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:15.697672 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dce422b-81ca-4647-a239-325a29df1482 None None] Pushing event updated for resources: {'Port': ['ID=23520980-2021-4b45-9862-72ac55d89059,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:15.723411 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd758cd-2e87-4ea1-ba8b-2530afbd02cd req-643b5a3d-9770-4932-8b77-2b844f0d0225 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:15.725145 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3fd758cd-2e87-4ea1-ba8b-2530afbd02cd req-643b5a3d-9770-4932-8b77-2b844f0d0225 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1122696 Nov 18 18:23:15.771167 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:14Z', 'revision_number': 3, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:14Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:15.797593 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Checking router: 0f9804e2-48c3-4648-b16c-33eeec3a9305 for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:23:15.797935 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Updating router 0f9804e2-48c3-4648-b16c-33eeec3a9305 port 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f binding host dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:23:15.822292 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3fd758cd-2e87-4ea1-ba8b-2530afbd02cd req-b3c08121-54d6-4077-b013-2f82caa3214a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0826337 Nov 18 18:23:15.823676 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:15.856762 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-adfa246f-cf44-4952-86a2-8ff43ee3c0d0 None None] Provisioning complete for port 23520980-2021-4b45-9862-72ac55d89059 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:15.857404 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-adfa246f-cf44-4952-86a2-8ff43ee3c0d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:15.993691 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.097844 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Publish callbacks [] for port, precommit_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.104436 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.142768 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Pushing event updated for resources: {'Port': ['ID=70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f,revision_number=2']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:16.152280 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.152658 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.153005 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.153332 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.153664 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.153992 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.154351 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.154679 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.154930 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Allocated IP 172.20.0.1 (584f2b3a-f3ea-4f7c-bcc9-711159cffa8a/cac1be0a-3676-49bd-8292-3623cc0fc8b1/4f9ac680-4b89-4f65-bc06-6239f90f19f3) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:16.155047 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.155311 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.155630 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.155970 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.180485 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Attempting to bind port 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:16.180922 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Attempting to bind port 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:16.181208 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Attempting to bind port 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f on network 2cab888d-52a8-434c-814e-4f25740decd0 {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:16.187259 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:16.187956 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Checking segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102691) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:16.188727 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.189123 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Bound using segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:16.189603 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Bound port: 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:16.189991 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.239611 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 23520980-2021-4b45-9862-72ac55d89059 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:16.243172 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] For port 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102691) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:16.246852 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] For port 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102691) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:16.253146 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.282367 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.297521 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 23520980-2021-4b45-9862-72ac55d89059 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:16.298168 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.319526 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d977b6ee-77ba-4647-a0ca-d868846642a1 None None] Pushing event updated for resources: {'Port': ['ID=70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f,revision_number=3']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:16.320709 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.328916 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Routers {'0f9804e2-48c3-4648-b16c-33eeec3a9305'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:16.331499 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['0f9804e2-48c3-4648-b16c-33eeec3a9305'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:16.356684 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:16.361483 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:16.365816 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:16.416492 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Pushing event updated for resources: {'Port': ['ID=4f9ac680-4b89-4f65-bc06-6239f90f19f3,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:16.430736 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.431086 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.431608 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.432152 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.432490 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.432830 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.433166 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.433501 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.433831 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.434157 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.434478 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.434957 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:16.444292 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-500260'] for router_interface, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.532959 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] Set router 0f9804e2-48c3-4648-b16c-33eeec3a9305 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:16.574427 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.662369 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-95ae81ac-1b59-4940-a8b9-6fd5ce506749 None None] Provisioning complete for port 4f9ac680-4b89-4f65-bc06-6239f90f19f3 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:16.663978 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-95ae81ac-1b59-4940-a8b9-6fd5ce506749 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.700683 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-95ae81ac-1b59-4940-a8b9-6fd5ce506749 None None] Port 4f9ac680-4b89-4f65-bc06-6239f90f19f3 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:23:16.732916 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:14Z', 'revision_number': 3, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:16.752538 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.757426 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.758902 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9d41ec5-ddba-467c-9c6e-bee71d82d126 None None] The sync data for ids ['0f9804e2-48c3-4648-b16c-33eeec3a9305'] in dv-cinder-787764-6-iscsi is: [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:14Z', 'revision_number': 3, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:23:16.828886 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Pushing event updated for resources: {'Port': ['ID=4f9ac680-4b89-4f65-bc06-6239f90f19f3,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:16.834751 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1772530', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-499092'] for router_interface, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:16.926325 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:16.927860 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:17.059031 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Router 0f9804e2-48c3-4648-b16c-33eeec3a9305 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:23:17.181312 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:23:17.186761 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-6d4d7e2a-f4aa-4ebc-a718-96da42b140e2 admin admin] 10.222.0.82 "PUT /v2.0/routers/0f9804e2-48c3-4648-b16c-33eeec3a9305/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7710509 Nov 18 18:23:17.224328 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-1933958e-3f6f-4c82-b3b1-ec7fda416140 None None] Provisioning complete for port 4f9ac680-4b89-4f65-bc06-6239f90f19f3 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:17.224697 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1933958e-3f6f-4c82-b3b1-ec7fda416140 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:17.259667 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-1933958e-3f6f-4c82-b3b1-ec7fda416140 None None] Port 4f9ac680-4b89-4f65-bc06-6239f90f19f3 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:23:17.743852 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38944) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:17.748663 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-820423817-network', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:17.769202 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Made reservation on behalf of c8e008dffadc4a8a84dc0bc8061ae697 for: {'network': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:23:17.771544 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:17.780239 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:17.854018 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:17.858020 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:17.871882 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Request body: {'port': {'device_id': '619976bf-fa6c-40cd-a53b-d98f17befea6', 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900', 'admin_state_up': True, 'tenant_id': '472f1c3f9a614eacab1165cd06691e36'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:17.883746 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1330} {{(pid=102688) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:23:17.893751 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=21f0a312-3697-4f3e-a4f6-1217a7152653,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:17.899871 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:17.900324 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.segments_db [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Added segment 184d64c9-8049-408c-9e5a-54f72d13ce49 of type vlan for network f961cc50-11d6-4545-80f0-cb15e6b8881d Nov 18 18:23:17.948640 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:17.977970 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:17.979136 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:17.979861 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.019146 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Made reservation on behalf of 472f1c3f9a614eacab1165cd06691e36 for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:23:18.024497 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.060381 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] Pushing event updated for resources: {'Network': ['ID=f961cc50-11d6-4545-80f0-cb15e6b8881d,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:18.065549 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-77597e79-086f-4918-85da-32efc69f7353 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3206241 Nov 18 18:23:18.068238 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 38952) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:18.071373 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network f961cc50-11d6-4545-80f0-cb15e6b8881d details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:23:18.073466 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-7d151b77-c772-4e7b-ae97-3683d2ee18ff admin admin] Request body: {'subnet': {'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-820423817-subnet', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'ip_version': 4}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:18.077610 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-33e44a59-5e58-4f1f-9012-d9e0a704cdd9 req-665ecd75-ce80-4b5d-a002-24d51aa1b634 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 210 time: 0.0423403 Nov 18 18:23:18.122867 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d151b77-c772-4e7b-ae97-3683d2ee18ff admin admin] Made reservation on behalf of c8e008dffadc4a8a84dc0bc8061ae697 for: {'subnet': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:23:18.125290 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7d151b77-c772-4e7b-ae97-3683d2ee18ff admin admin] Publish callbacks [] for subnet, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.230995 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-090d00b7-2de8-4e1b-a4b9-5bedff47881d req-6c79ed47-cd4c-4bbd-a5a2-662bef40cd4f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:18.232799 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-090d00b7-2de8-4e1b-a4b9-5bedff47881d req-6c79ed47-cd4c-4bbd-a5a2-662bef40cd4f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1693628 Nov 18 18:23:18.261471 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:18.320838 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:18.321699 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.336449 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-090d00b7-2de8-4e1b-a4b9-5bedff47881d req-15506a15-baea-45b0-aa80-7f054589ccdd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0931299 Nov 18 18:23:18.361355 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Allocated IP 172.20.0.8 (f06fa801-dbf4-454b-984e-82c11cc6c900/d477b94e-c409-446d-9434-db6811cbe863/d070011f-e438-4b08-b097-5cac8c261ba4) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:18.398140 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7d151b77-c772-4e7b-ae97-3683d2ee18ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.412301 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.446087 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:18.458338 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.461402 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d151b77-c772-4e7b-ae97-3683d2ee18ff admin admin] Pushing event updated for resources: {'Subnet': ['ID=cd3ac6d9-a01b-4af0-8cf6-bc22a308025d,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:18.471711 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d151b77-c772-4e7b-ae97-3683d2ee18ff admin admin] Checking segment: {'id': '184d64c9-8049-408c-9e5a-54f72d13ce49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1330, 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:18.472311 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d151b77-c772-4e7b-ae97-3683d2ee18ff admin admin] Network hostable DHCP agents. Network: f961cc50-11d6-4545-80f0-cb15e6b8881d, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102688) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:23:18.494963 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d151b77-c772-4e7b-ae97-3683d2ee18ff admin admin] Network f961cc50-11d6-4545-80f0-cb15e6b8881d is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102688) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:23:18.510487 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-7d151b77-c772-4e7b-ae97-3683d2ee18ff admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, f961cc50-11d6-4545-80f0-cb15e6b8881d) {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:18.525752 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d151b77-c772-4e7b-ae97-3683d2ee18ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:18.526996 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7d151b77-c772-4e7b-ae97-3683d2ee18ff admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.527261 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54b10f42-b84e-4e1d-bf67-562bbb1c1a5b None None] Network f961cc50-11d6-4545-80f0-cb15e6b8881d requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:23:18.548712 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-7d151b77-c772-4e7b-ae97-3683d2ee18ff admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4789813 Nov 18 18:23:18.549523 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 38958) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:18.549812 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:18.556463 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-820423817-router', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:18.562107 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.568317 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:18.568676 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:18.569524 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:18.569872 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:18.570210 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:18.570551 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:18.570861 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:18.571231 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:18.571599 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:18.571848 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:18.572198 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:18.572527 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:23:18.600066 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-430558', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-543'] for router, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.601241 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-430410', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-500004', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1631324', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-534'] for router, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.641339 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Sync routers for ids ['0f9804e2-48c3-4648-b16c-33eeec3a9305'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:23:18.659826 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.661344 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:18.731882 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Routers {'0f9804e2-48c3-4648-b16c-33eeec3a9305'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:18.733302 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['0f9804e2-48c3-4648-b16c-33eeec3a9305'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:18.988948 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Network f06fa801-dbf4-454b-984e-82c11cc6c900 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:18.996114 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:19.015718 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc1c763e3-2102-51f8-97fe-c751e57774c1-f961cc50-11d6-4545-80f0-cb15e6b8881d', 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'fixed_ips': [{'subnet_id': 'cd3ac6d9-a01b-4af0-8cf6-bc22a308025d'}]}} from dv-cinder-787764-6-iscsi. {{(pid=102690) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 18:23:19.016595 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.030738 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:19.064084 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Pushing event updated for resources: {'Port': ['ID=d070011f-e438-4b08-b097-5cac8c261ba4,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:19.065166 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Set router 0f9804e2-48c3-4648-b16c-33eeec3a9305 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:19.143664 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.152473 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:19.153345 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.187233 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-ced7096d-2718-4a32-a435-ed96cf49c6b6 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3294709 Nov 18 18:23:19.239261 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Request body: {'port': {'device_id': '619976bf-fa6c-40cd-a53b-d98f17befea6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:19.294741 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add12252-3f81-477c-b535-b4d8e2b5c7ff req-f46bbcc7-de8f-410e-b2e5-60948bb5560b tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:19.296294 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-add12252-3f81-477c-b535-b4d8e2b5c7ff req-f46bbcc7-de8f-410e-b2e5-60948bb5560b tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 931 time: 0.1019912 Nov 18 18:23:19.320643 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.db_base_plugin_common [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Allocated IP 172.20.0.2 (f961cc50-11d6-4545-80f0-cb15e6b8881d/cd3ac6d9-a01b-4af0-8cf6-bc22a308025d/b3ec7111-b763-4f53-a3c8-7f676200679b) {{(pid=102690) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:19.378165 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.439972 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-add12252-3f81-477c-b535-b4d8e2b5c7ff req-7d567c2d-7596-4a4f-9811-f74965d27149 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1109352 Nov 18 18:23:19.472701 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:16Z', 'revision_number': 4, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '4f9ac680-4b89-4f65-bc06-6239f90f19f3', 'name': '', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'mac_address': 'fa:16:3e:ae:a5:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_interface', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:16Z', 'updated_at': '2021-11-18T18:23:16Z', 'revision_number': 2, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'subnets': [{'id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:19.516134 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Checking router: 0f9804e2-48c3-4648-b16c-33eeec3a9305 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:23:19.516496 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Updating router 0f9804e2-48c3-4648-b16c-33eeec3a9305 port 4f9ac680-4b89-4f65-bc06-6239f90f19f3 binding host dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:23:19.557025 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.561512 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Publish callbacks [] for port, precommit_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.572574 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.632407 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Network f961cc50-11d6-4545-80f0-cb15e6b8881d is already hosted by enough agents. {{(pid=102690) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:19.632772 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b86435-8392-498a-8d89-b202ea2e4a81 req-52d799c2-ac1c-4978-90c3-608711363b8d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:19.634252 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-24b86435-8392-498a-8d89-b202ea2e4a81 req-52d799c2-ac1c-4978-90c3-608711363b8d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1982553 Nov 18 18:23:19.637847 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.base_scheduler [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Resources bound (agent type, host, resource id): {{(pid=102690) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:19.642579 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Received port after_create {{(pid=102690) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:19.697271 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Pushing event updated for resources: {'Port': ['ID=b3ec7111-b763-4f53-a3c8-7f676200679b,revision_number=1']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:19.720214 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.767709 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Attempting to bind port b3ec7111-b763-4f53-a3c8-7f676200679b on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:19.768109 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Attempting to bind port b3ec7111-b763-4f53-a3c8-7f676200679b by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '184d64c9-8049-408c-9e5a-54f72d13ce49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1330, 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:19.768780 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Attempting to bind port b3ec7111-b763-4f53-a3c8-7f676200679b on network f961cc50-11d6-4545-80f0-cb15e6b8881d {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:19.776729 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.783167 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:19.783543 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Checking segment: {'id': '184d64c9-8049-408c-9e5a-54f72d13ce49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1330, 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:19.783969 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.784375 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Bound using segment: {'id': '184d64c9-8049-408c-9e5a-54f72d13ce49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1330, 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:19.784850 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Bound port: b3ec7111-b763-4f53-a3c8-7f676200679b, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '184d64c9-8049-408c-9e5a-54f72d13ce49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1330, 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:19.785230 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.798205 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-24b86435-8392-498a-8d89-b202ea2e4a81 req-7dcf2749-d4d1-4a6b-9f89-1341a95c5271 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1379976 Nov 18 18:23:19.912317 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] For port b3ec7111-b763-4f53-a3c8-7f676200679b, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:19.930102 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] For port b3ec7111-b763-4f53-a3c8-7f676200679b, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=b3ec7111-b763-4f53-a3c8-7f676200679b,segment=NetworkSegment(184d64c9-8049-408c-9e5a-54f72d13ce49),segment_id=184d64c9-8049-408c-9e5a-54f72d13ce49)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:19.947700 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.955057 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d070011f-e438-4b08-b097-5cac8c261ba4 {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:23:19.971901 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:19.974639 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Allocated IP 172.27.1.65 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/7338786c-8201-4395-989f-2f80d260bb87) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:19.999350 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Transition to ACTIVE for port object d070011f-e438-4b08-b097-5cac8c261ba4 will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:23:20.013585 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.035365 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa9edbc5-0b72-468c-a56a-9fdc1639b500 None None] Pushing event updated for resources: {'Port': ['ID=b3ec7111-b763-4f53-a3c8-7f676200679b,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:20.063505 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Publish callbacks [] for port, precommit_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.072552 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.110887 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Pushing event updated for resources: {'Port': ['ID=d070011f-e438-4b08-b097-5cac8c261ba4,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:20.128749 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5993b5c-f8c4-498e-a243-17544dc17f98 None None] Pushing event updated for resources: {'Port': ['ID=4f9ac680-4b89-4f65-bc06-6239f90f19f3,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:20.188458 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Attempting to bind port 4f9ac680-4b89-4f65-bc06-6239f90f19f3 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:20.188834 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Attempting to bind port 4f9ac680-4b89-4f65-bc06-6239f90f19f3 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:20.189207 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Attempting to bind port 4f9ac680-4b89-4f65-bc06-6239f90f19f3 on network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:20.199046 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:20.199413 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Checking segment: {'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:20.199768 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.206376 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Bound using segment: {'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:20.206376 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Bound port: 4f9ac680-4b89-4f65-bc06-6239f90f19f3, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:20.206376 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.228707 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.286165 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Attempting to bind port d070011f-e438-4b08-b097-5cac8c261ba4 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:20.286498 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Attempting to bind port d070011f-e438-4b08-b097-5cac8c261ba4 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': 'd50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:20.286827 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Attempting to bind port d070011f-e438-4b08-b097-5cac8c261ba4 on network f06fa801-dbf4-454b-984e-82c11cc6c900 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:20.301771 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Port d070011f-e438-4b08-b097-5cac8c261ba4 on network f06fa801-dbf4-454b-984e-82c11cc6c900 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:23:20.302091 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Attempting to bind port d070011f-e438-4b08-b097-5cac8c261ba4 on network f06fa801-dbf4-454b-984e-82c11cc6c900 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:20.318703 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 22, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:20.319599 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Checking segment: {'id': 'd50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:20.320048 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Bound using segment: {'id': 'd50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:20.320494 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Bound port: d070011f-e438-4b08-b097-5cac8c261ba4, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:20.320849 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.346624 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] For port 4f9ac680-4b89-4f65-bc06-6239f90f19f3, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:20.350604 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] For port 4f9ac680-4b89-4f65-bc06-6239f90f19f3, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=4f9ac680-4b89-4f65-bc06-6239f90f19f3,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:20.354976 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:20.358864 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.360912 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.480945 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:20.487066 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5993b5c-f8c4-498e-a243-17544dc17f98 None None] Pushing event updated for resources: {'Port': ['ID=4f9ac680-4b89-4f65-bc06-6239f90f19f3,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:20.491884 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:20.519703 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:20.524877 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Pushing event updated for resources: {'Port': ['ID=7338786c-8201-4395-989f-2f80d260bb87,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:20.548959 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-0de14343-4037-42a9-bc22-534429e37b9c None None] Provisioning complete for port 4f9ac680-4b89-4f65-bc06-6239f90f19f3 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:20.549211 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-0de14343-4037-42a9-bc22-534429e37b9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.551183 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Routers {'0f9804e2-48c3-4648-b16c-33eeec3a9305'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:20.551908 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['0f9804e2-48c3-4648-b16c-33eeec3a9305'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:20.559773 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] For port d070011f-e438-4b08-b097-5cac8c261ba4, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:20.576938 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] For port d070011f-e438-4b08-b097-5cac8c261ba4, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=d070011f-e438-4b08-b097-5cac8c261ba4,segment=NetworkSegment(d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20),segment_id=d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:20.586148 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.645681 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:20.646049 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.697284 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:20.697918 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.699322 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-bf442587-9568-4d82-abaa-373bee45033a service neutron] 10.222.0.31 "PUT /v2.0/ports/d070011f-e438-4b08-b097-5cac8c261ba4 HTTP/1.1" status: 200 len: 1093 time: 1.4668081 Nov 18 18:23:20.699830 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '619976bf-fa6c-40cd-a53b-d98f17befea6', 'tag': 'd070011f-e438-4b08-b097-5cac8c261ba4'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:23:20.702119 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-563db3c5-0d6c-4c5d-a709-1e959c1bab7f" -d '{"events": [{"name": "network-changed", "server_uuid": "619976bf-fa6c-40cd-a53b-d98f17befea6", "tag": "d070011f-e438-4b08-b097-5cac8c261ba4"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:23:20.747784 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf442587-9568-4d82-abaa-373bee45033a service neutron] Pushing event updated for resources: {'Port': ['ID=d070011f-e438-4b08-b097-5cac8c261ba4,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:20.761319 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] Set router 0f9804e2-48c3-4648-b16c-33eeec3a9305 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:20.804225 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-0de14343-4037-42a9-bc22-534429e37b9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:20.873483 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:21.050309 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-0de14343-4037-42a9-bc22-534429e37b9c None None] For port 4f9ac680-4b89-4f65-bc06-6239f90f19f3, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=4f9ac680-4b89-4f65-bc06-6239f90f19f3,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:21.063520 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-0de14343-4037-42a9-bc22-534429e37b9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:21.100740 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-430421', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-500439'] for router, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:21.161951 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:21.200321 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0de14343-4037-42a9-bc22-534429e37b9c None None] Pushing event updated for resources: {'Port': ['ID=4f9ac680-4b89-4f65-bc06-6239f90f19f3,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:21.229758 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-b2786d4f-170f-4846-9540-87e9e0874270 None None] Provisioning complete for port 4f9ac680-4b89-4f65-bc06-6239f90f19f3 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:21.230238 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-b2786d4f-170f-4846-9540-87e9e0874270 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:21.254949 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Router 13c2661f-fac1-483e-824d-3d28144d3cb6 is scheduled to L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 with binding_index 1 {{(pid=102689) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 18:23:21.290390 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-876990d8-717d-4384-a3e2-ff539c7e1fb5 None None] Network f961cc50-11d6-4545-80f0-cb15e6b8881d requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:23:21.305313 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:16Z', 'revision_number': 4, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '4f9ac680-4b89-4f65-bc06-6239f90f19f3', 'name': '', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'mac_address': 'fa:16:3e:ae:a5:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_interface', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:16Z', 'updated_at': '2021-11-18T18:23:20Z', 'revision_number': 4, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'subnets': [{'id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:21.345425 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-067dcb2e-b33c-400c-9d75-2f0acb37e08b None None] The sync data for ids ['0f9804e2-48c3-4648-b16c-33eeec3a9305'] in dv-cinder-787764-6-iscsi is: [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:16Z', 'revision_number': 4, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '4f9ac680-4b89-4f65-bc06-6239f90f19f3', 'name': '', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'mac_address': 'fa:16:3e:ae:a5:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_interface', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:16Z', 'updated_at': '2021-11-18T18:23:20Z', 'revision_number': 4, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'subnets': [{'id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:23:21.563835 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-dd008a19-4248-4e25-aa49-6fa9a83f681a None None] Provisioning complete for port b3ec7111-b763-4f53-a3c8-7f676200679b triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:21.564542 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-dd008a19-4248-4e25-aa49-6fa9a83f681a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:21.598162 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:23:21.611527 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Sync routers for ids ['13c2661f-fac1-483e-824d-3d28144d3cb6'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:23:21.622060 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] Publish callbacks [] for router, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:21.623836 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-71096676-3ee3-4d09-85ee-968f45712b52 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 3.0728133 Nov 18 18:23:21.626668 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39012) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:21.630637 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Routers {'13c2661f-fac1-483e-824d-3d28144d3cb6'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:21.631263 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['13c2661f-fac1-483e-824d-3d28144d3cb6'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:21.678387 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-dd008a19-4248-4e25-aa49-6fa9a83f681a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:21.714362 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-dd008a19-4248-4e25-aa49-6fa9a83f681a None None] For port b3ec7111-b763-4f53-a3c8-7f676200679b, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=b3ec7111-b763-4f53-a3c8-7f676200679b,segment=NetworkSegment(184d64c9-8049-408c-9e5a-54f72d13ce49),segment_id=184d64c9-8049-408c-9e5a-54f72d13ce49)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:21.718258 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-dd008a19-4248-4e25-aa49-6fa9a83f681a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:21.793829 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd008a19-4248-4e25-aa49-6fa9a83f681a None None] Pushing event updated for resources: {'Port': ['ID=b3ec7111-b763-4f53-a3c8-7f676200679b,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:21.795017 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Set router 13c2661f-fac1-483e-824d-3d28144d3cb6 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:21.841990 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-28f8bfe2-bd76-4349-a6b6-b530ffe21be3 None None] Provisioning complete for port b3ec7111-b763-4f53-a3c8-7f676200679b triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:21.842372 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-28f8bfe2-bd76-4349-a6b6-b530ffe21be3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:22.005287 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'name': 'tempest-TestShelveInstance-820423817-router', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65'}], 'enable_snat': True}, 'gw_port_id': '7338786c-8201-4395-989f-2f80d260bb87', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:18Z', 'updated_at': '2021-11-18T18:23:20Z', 'revision_number': 3, 'project_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'gw_port': {'id': '7338786c-8201-4395-989f-2f80d260bb87', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:6c:fe:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:19Z', 'updated_at': '2021-11-18T18:23:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:22.039343 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Checking router: 13c2661f-fac1-483e-824d-3d28144d3cb6 for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:23:22.039696 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Updating router 13c2661f-fac1-483e-824d-3d28144d3cb6 port 7338786c-8201-4395-989f-2f80d260bb87 binding host dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:23:22.065867 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:22.146698 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:22.305356 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device b3ec7111-b763-4f53-a3c8-7f676200679b up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:22.375412 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-3820e5b3-4928-4dfa-971d-c1cefdc26b50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:22.377463 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-3820e5b3-4928-4dfa-971d-c1cefdc26b50 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=472f1c3f9a614eacab1165cd06691e36&device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 1096 time: 0.0730081 Nov 18 18:23:22.485982 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Allocated IP 172.20.0.1 (f961cc50-11d6-4545-80f0-cb15e6b8881d/cd3ac6d9-a01b-4af0-8cf6-bc22a308025d/aa9da10c-d74d-4dc3-99c9-055b24cc4110) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:22.493899 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-22dc2d9e-6165-4cd5-bfd0-7be0d8cdee0a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=d070011f-e438-4b08-b097-5cac8c261ba4 HTTP/1.1" status: 200 len: 217 time: 0.1016619 Nov 18 18:23:22.499698 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port b3ec7111-b763-4f53-a3c8-7f676200679b triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:22.504567 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:22.646098 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Publish callbacks [] for port, precommit_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:22.660303 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:23:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5fa78897-7df4-4a59-8f92-05cc87cf5601 x-openstack-request-id: req-5fa78897-7df4-4a59-8f92-05cc87cf5601 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:23:22.661099 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "619976bf-fa6c-40cd-a53b-d98f17befea6", "tag": "d070011f-e438-4b08-b097-5cac8c261ba4", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:23:22.661707 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-5fa78897-7df4-4a59-8f92-05cc87cf5601 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:23:22.662523 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '619976bf-fa6c-40cd-a53b-d98f17befea6', 'tag': 'd070011f-e438-4b08-b097-5cac8c261ba4', 'status': 'completed', 'code': 200} Nov 18 18:23:22.663206 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:22.692922 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ee442b-20f4-442c-a9d1-f5d1c637a1ec req-4f2ad689-35e1-4544-9f30-be6f027b0941 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:22.696745 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d1ee442b-20f4-442c-a9d1-f5d1c637a1ec req-4f2ad689-35e1-4544-9f30-be6f027b0941 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 1098 time: 0.2984445 Nov 18 18:23:22.704493 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-e2cff761-4344-4c18-affe-aca50a64d130 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:22.707126 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-e2cff761-4344-4c18-affe-aca50a64d130 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d477b94e-c409-446d-9434-db6811cbe863 HTTP/1.1" status: 200 len: 848 time: 0.1873679 Nov 18 18:23:22.723434 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771fa7aa-f42d-47b5-aa75-dd081cdf807e req-dfd45359-2973-41d8-baf8-7d01b9b7a82f tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:22.725990 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 4f9ac680-4b89-4f65-bc06-6239f90f19f3 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:22.727093 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-771fa7aa-f42d-47b5-aa75-dd081cdf807e req-dfd45359-2973-41d8-baf8-7d01b9b7a82f tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 943 time: 0.3296862 Nov 18 18:23:22.740272 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14b33ee7-8a44-4313-9542-0f6d55e22cc2 None None] Pushing event updated for resources: {'Port': ['ID=7338786c-8201-4395-989f-2f80d260bb87,revision_number=2']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:22.761707 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:22.788625 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Attempting to bind port 7338786c-8201-4395-989f-2f80d260bb87 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:22.789023 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Attempting to bind port 7338786c-8201-4395-989f-2f80d260bb87 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:22.789292 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Attempting to bind port 7338786c-8201-4395-989f-2f80d260bb87 on network 2cab888d-52a8-434c-814e-4f25740decd0 {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:22.795540 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:22.795994 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Checking segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102691) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:22.796350 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:22.796744 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Bound using segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:22.797212 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Bound port: 7338786c-8201-4395-989f-2f80d260bb87, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:22.799903 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:22.839538 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 4f9ac680-4b89-4f65-bc06-6239f90f19f3 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:22.840467 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:22.893387 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] For port 7338786c-8201-4395-989f-2f80d260bb87, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102691) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:22.898199 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] For port 7338786c-8201-4395-989f-2f80d260bb87, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=7338786c-8201-4395-989f-2f80d260bb87,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102691) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:22.909181 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:22.936497 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-689edcea-d740-4453-af31-5b6295d0a9ee service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f06fa801-dbf4-454b-984e-82c11cc6c900&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1277366 Nov 18 18:23:22.960306 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:22.998406 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14b33ee7-8a44-4313-9542-0f6d55e22cc2 None None] Pushing event updated for resources: {'Port': ['ID=7338786c-8201-4395-989f-2f80d260bb87,revision_number=3']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:23.020230 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f71ab805-eae6-4255-a20d-1dbee766a2be req-bac05c42-f162-4411-a1c7-c81efec2b51a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:23.032936 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f71ab805-eae6-4255-a20d-1dbee766a2be req-bac05c42-f162-4411-a1c7-c81efec2b51a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.3341119 Nov 18 18:23:23.066099 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Routers {'13c2661f-fac1-483e-824d-3d28144d3cb6'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:23.068731 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['13c2661f-fac1-483e-824d-3d28144d3cb6'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:23.138781 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Network f961cc50-11d6-4545-80f0-cb15e6b8881d is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:23.148906 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:23.164335 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:23.165043 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-500260'] for router_interface, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:23.167867 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-771fa7aa-f42d-47b5-aa75-dd081cdf807e req-761399bf-4545-40a0-adc0-62a2a0ce22c5 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4288328 Nov 18 18:23:23.181584 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ee442b-20f4-442c-a9d1-f5d1c637a1ec req-77908a80-3016-4314-8b23-b9ee7c16c6f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:23.190592 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d1ee442b-20f4-442c-a9d1-f5d1c637a1ec req-77908a80-3016-4314-8b23-b9ee7c16c6f2 service neutron] 10.222.0.31 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 921 time: 0.4023781 Nov 18 18:23:23.222561 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f71ab805-eae6-4255-a20d-1dbee766a2be req-e570334c-f4eb-400f-9355-9115bee6a46b tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1834872 Nov 18 18:23:23.230255 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dde970b-38a4-412e-980d-472451e80802 req-ffa405d7-6489-43f0-b7c5-8fc42dc71405 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:23.231769 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6dde970b-38a4-412e-980d-472451e80802 req-ffa405d7-6489-43f0-b7c5-8fc42dc71405 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 1098 time: 0.1799102 Nov 18 18:23:23.243879 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] Set router 13c2661f-fac1-483e-824d-3d28144d3cb6 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:23.336502 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6dde970b-38a4-412e-980d-472451e80802 req-c05a621e-f7ee-4b5d-a99f-4614b01c0720 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0888197 Nov 18 18:23:23.348704 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Pushing event updated for resources: {'Port': ['ID=aa9da10c-d74d-4dc3-99c9-055b24cc4110,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:23.360794 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-417da27a-2b06-4770-8c48-6e96bc9d8615 service neutron] 10.222.0.31 "GET /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4044342 Nov 18 18:23:23.446543 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d1ee442b-20f4-442c-a9d1-f5d1c637a1ec req-a1114066-a961-45ca-8a7b-35ec67470014 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b627bee7-04b0-4a31-8ff0-84f976c65917 HTTP/1.1" status: 200 len: 217 time: 0.2359617 Nov 18 18:23:23.575196 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'name': 'tempest-TestShelveInstance-820423817-router', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65'}], 'enable_snat': True}, 'gw_port_id': '7338786c-8201-4395-989f-2f80d260bb87', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:18Z', 'updated_at': '2021-11-18T18:23:20Z', 'revision_number': 3, 'project_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'gw_port': {'id': '7338786c-8201-4395-989f-2f80d260bb87', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:6c:fe:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:19Z', 'updated_at': '2021-11-18T18:23:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:23.592896 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-583b3afb-abab-4591-b116-f2d9f4a198a1 None None] Provisioning complete for port aa9da10c-d74d-4dc3-99c9-055b24cc4110 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:23.593492 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:23.595042 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-583b3afb-abab-4591-b116-f2d9f4a198a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:23.620594 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ef203a1-2dee-41e5-86ac-7dfd4fdf61ac None None] The sync data for ids ['13c2661f-fac1-483e-824d-3d28144d3cb6'] in dv-cinder-787764-6-iscsi is: [{'id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'name': 'tempest-TestShelveInstance-820423817-router', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65'}], 'enable_snat': True}, 'gw_port_id': '7338786c-8201-4395-989f-2f80d260bb87', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:18Z', 'updated_at': '2021-11-18T18:23:20Z', 'revision_number': 3, 'project_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'gw_port': {'id': '7338786c-8201-4395-989f-2f80d260bb87', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:6c:fe:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:19Z', 'updated_at': '2021-11-18T18:23:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:23:23.674658 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 39044) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:23.696591 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ee442b-20f4-442c-a9d1-f5d1c637a1ec req-d8e343bf-082c-4996-a39d-08881578c68c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:23.707741 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-583b3afb-abab-4591-b116-f2d9f4a198a1 None None] Port aa9da10c-d74d-4dc3-99c9-055b24cc4110 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:23:23.707871 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d1ee442b-20f4-442c-a9d1-f5d1c637a1ec req-d8e343bf-082c-4996-a39d-08881578c68c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 HTTP/1.1" status: 200 len: 859 time: 0.0644336 Nov 18 18:23:23.791887 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d1ee442b-20f4-442c-a9d1-f5d1c637a1ec req-60b559ad-62e0-4b8b-9e27-2a9ab39e9a71 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0722311 Nov 18 18:23:23.840793 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1ee3067-b4d1-4f39-87eb-711bab070811 req-b6db988a-13f1-4d76-a92c-a4181f23f46d service neutron] 10.222.0.31 "GET /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2106268 Nov 18 18:23:23.891712 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6a9fca89-b045-4b0c-9c15-6af5468a5f80 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.002708 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-563db3c5-0d6c-4c5d-a709-1e959c1bab7f req-1981d244-815e-4951-93e5-d57ff372ab3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:24.004354 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-563db3c5-0d6c-4c5d-a709-1e959c1bab7f req-1981d244-815e-4951-93e5-d57ff372ab3a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=472f1c3f9a614eacab1165cd06691e36&device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 1096 time: 0.0771999 Nov 18 18:23:24.070541 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d1ee442b-20f4-442c-a9d1-f5d1c637a1ec req-e9f23400-ddc0-4b5c-9ba2-ce2487c2ff1a service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2414527 Nov 18 18:23:24.092806 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6a9fca89-b045-4b0c-9c15-6af5468a5f80 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.114949 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.135294 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.136071 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1772530', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-499092'] for router_interface, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.145055 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6a9fca89-b045-4b0c-9c15-6af5468a5f80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.212493 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Pushing event updated for resources: {'Port': ['ID=aa9da10c-d74d-4dc3-99c9-055b24cc4110,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:24.214740 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-6a9fca89-b045-4b0c-9c15-6af5468a5f80 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d9225478714c4539b85c44870a60ad2a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5379951 Nov 18 18:23:24.215011 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39060) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:24.222083 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a9fca89-b045-4b0c-9c15-6af5468a5f80 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3f7a5be-5d6c-40f5-b9f9-4b19c740e9b2,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:24.233295 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-563db3c5-0d6c-4c5d-a709-1e959c1bab7f req-6d6e5047-4e4e-4edb-a89e-4cfd68412500 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:24.235086 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-563db3c5-0d6c-4c5d-a709-1e959c1bab7f req-6d6e5047-4e4e-4edb-a89e-4cfd68412500 service neutron] 10.222.0.31 "GET /v2.0/networks?id=f06fa801-dbf4-454b-984e-82c11cc6c900 HTTP/1.1" status: 200 len: 910 time: 0.2132711 Nov 18 18:23:24.308126 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-563db3c5-0d6c-4c5d-a709-1e959c1bab7f req-e529debf-59f8-4271-b485-fc92c878755a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=d070011f-e438-4b08-b097-5cac8c261ba4 HTTP/1.1" status: 200 len: 217 time: 0.0581226 Nov 18 18:23:24.367240 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d1ee442b-20f4-442c-a9d1-f5d1c637a1ec req-ced3d534-fdb9-45b4-961c-86860072d5b3 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2847788 Nov 18 18:23:24.371537 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 7338786c-8201-4395-989f-2f80d260bb87 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:24.414511 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Network f961cc50-11d6-4545-80f0-cb15e6b8881d is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:24.417169 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:24.427346 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3c0fee6c-7711-4af9-ae11-03606acfe192 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.444536 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-563db3c5-0d6c-4c5d-a709-1e959c1bab7f req-ff260348-2cf6-4ede-898b-5bd5b56810bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:24.446296 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-563db3c5-0d6c-4c5d-a709-1e959c1bab7f req-ff260348-2cf6-4ede-898b-5bd5b56810bf service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d477b94e-c409-446d-9434-db6811cbe863 HTTP/1.1" status: 200 len: 848 time: 0.1244192 Nov 18 18:23:24.460657 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe5d5b1-7e0d-45be-95e2-9fe55a282200 req-fa7d1d73-daa7-402e-b9d3-c77859311e29 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:24.462182 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2fe5d5b1-7e0d-45be-95e2-9fe55a282200 req-fa7d1d73-daa7-402e-b9d3-c77859311e29 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 943 time: 0.1567404 Nov 18 18:23:24.471344 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b46e0a5c-877b-49ae-aff9-b692af2adb2f req-db15815d-2c8c-41df-9b7b-401c3d152116 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:24.473164 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b46e0a5c-877b-49ae-aff9-b692af2adb2f req-db15815d-2c8c-41df-9b7b-401c3d152116 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1524334 Nov 18 18:23:24.493280 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 7338786c-8201-4395-989f-2f80d260bb87 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:24.493988 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.507073 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3c0fee6c-7711-4af9-ae11-03606acfe192 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.579475 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b46e0a5c-877b-49ae-aff9-b692af2adb2f req-4c158cfa-a88f-4f28-bb0a-8306f20dd173 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991092 Nov 18 18:23:24.584741 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-563db3c5-0d6c-4c5d-a709-1e959c1bab7f req-c7935b32-b776-4c5e-959a-667cb9517db9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f06fa801-dbf4-454b-984e-82c11cc6c900&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1212726 Nov 18 18:23:24.620943 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.650379 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Router 13c2661f-fac1-483e-824d-3d28144d3cb6 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102688) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:23:24.657959 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port 7338786c-8201-4395-989f-2f80d260bb87, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=7338786c-8201-4395-989f-2f80d260bb87,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:24.659030 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3c0fee6c-7711-4af9-ae11-03606acfe192 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.661996 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3c0fee6c-7711-4af9-ae11-03606acfe192 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.664018 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-3c0fee6c-7711-4af9-ae11-03606acfe192 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c3f7a5be-5d6c-40f5-b9f9-4b19c740e9b2 HTTP/1.1" status: 204 len: 168 time: 0.4450359 Nov 18 18:23:24.666485 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.679055 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2fe5d5b1-7e0d-45be-95e2-9fe55a282200 req-0425b91f-dc26-4645-920a-eb353eb84744 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1856227 Nov 18 18:23:24.734623 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=7338786c-8201-4395-989f-2f80d260bb87,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:24.775444 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-51774b0f-e91d-486c-871b-f45d961f9ac6 None None] Provisioning complete for port aa9da10c-d74d-4dc3-99c9-055b24cc4110 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:24.775991 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-51774b0f-e91d-486c-871b-f45d961f9ac6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:24.828591 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c0fee6c-7711-4af9-ae11-03606acfe192 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3f7a5be-5d6c-40f5-b9f9-4b19c740e9b2,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:24.829184 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-563db3c5-0d6c-4c5d-a709-1e959c1bab7f req-dbc94622-4054-48f9-8f26-538432541e0b service neutron] 10.222.0.31 "GET /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2168310 Nov 18 18:23:24.830685 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-51774b0f-e91d-486c-871b-f45d961f9ac6 None None] Port aa9da10c-d74d-4dc3-99c9-055b24cc4110 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:23:24.934064 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:23:24.948417 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-0539e8d8-eb68-4f0e-8f43-e81a797d573f admin admin] 10.222.0.82 "PUT /v2.0/routers/13c2661f-fac1-483e-824d-3d28144d3cb6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3201017 Nov 18 18:23:24.975204 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-563db3c5-0d6c-4c5d-a709-1e959c1bab7f req-a405c91b-0154-4390-a56b-a6c5218d7ead service neutron] 10.222.0.31 "GET /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1257586 Nov 18 18:23:25.695647 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f72897e-4c53-45c2-83d9-269f7e6547bd req-b89939cb-fa92-4b66-a1e4-48d495f35417 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:25.698121 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0f72897e-4c53-45c2-83d9-269f7e6547bd req-b89939cb-fa92-4b66-a1e4-48d495f35417 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0536366 Nov 18 18:23:25.704585 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39106) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:25.712157 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 39110) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:25.723542 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-99c7d142-eafd-47ef-afe6-3a392b130487 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1510703379', 'description': 'tempest-secgroup-smoke-1510703379 description', 'project_id': '029e580af1e3498aa00c86f5ce660a80'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:25.812406 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-99c7d142-eafd-47ef-afe6-3a392b130487 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:25.817423 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0f72897e-4c53-45c2-83d9-269f7e6547bd req-5faef149-9b40-4ace-8b76-88318e15a4c7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1128573 Nov 18 18:23:25.820825 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1941240008-network', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:25.847579 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Made reservation on behalf of 46a1cb48de6e4f43a563f40fd92f0bf0 for: {'network': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:23:25.849931 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:25.854451 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0c07e8e-03b8-4632-b14b-6b2a7e8b5a21 req-d08d8116-009c-445c-8317-f73ff0c75a6c tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:25.855991 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a0c07e8e-03b8-4632-b14b-6b2a7e8b5a21 req-d08d8116-009c-445c-8317-f73ff0c75a6c tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 943 time: 0.0889022 Nov 18 18:23:25.860853 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:25.941554 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-99c7d142-eafd-47ef-afe6-3a392b130487 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:25.953728 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a0c07e8e-03b8-4632-b14b-6b2a7e8b5a21 req-d5604449-11fe-4aa9-a4e3-2dbada36c11d tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0876970 Nov 18 18:23:25.954966 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-99c7d142-eafd-47ef-afe6-3a392b130487 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:25.978250 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:25.985969 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:25.995000 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-99c7d142-eafd-47ef-afe6-3a392b130487 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:25.996263 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-99c7d142-eafd-47ef-afe6-3a392b130487 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2828631 Nov 18 18:23:25.999214 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 39118) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:26.004808 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-70e65644-916e-4ef7-9ef9-d3843c01a9f1 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Request body: {'security_group_rule': {'security_group_id': '7d840379-2de9-4453-883d-266a12b03984', 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:26.011146 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99c7d142-eafd-47ef-afe6-3a392b130487 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7d840379-2de9-4453-883d-266a12b03984,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:26.012618 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1305} {{(pid=102688) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:23:26.025683 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.026412 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.segments_db [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Added segment 6a4ec92d-4943-4121-a1de-1611106781cb of type vlan for network c5332eb5-c186-4bcf-89d9-eb78be973548 Nov 18 18:23:26.068349 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-70e65644-916e-4ef7-9ef9-d3843c01a9f1 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.099176 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.103599 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:26.134056 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.135187 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:26.135958 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.231711 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-70e65644-916e-4ef7-9ef9-d3843c01a9f1 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.232528 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 7338786c-8201-4395-989f-2f80d260bb87 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:26.237338 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] Pushing event updated for resources: {'Network': ['ID=c5332eb5-c186-4bcf-89d9-eb78be973548,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:26.244397 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-f53d04e9-bc60-4870-bf5d-c62740c11fe8 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.5387394 Nov 18 18:23:26.247346 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39130) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:26.253695 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-5a32b419-f305-4536-8327-ed3d7115adce admin admin] Request body: {'subnet': {'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1941240008-subnet', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'ip_version': 4}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:26.258746 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54e80f8-d2a3-4967-a880-e54e5074d81a req-6a746eaa-c107-4367-bb0f-fef902c52fce tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:26.266554 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a54e80f8-d2a3-4967-a880-e54e5074d81a req-6a746eaa-c107-4367-bb0f-fef902c52fce tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1826367 Nov 18 18:23:26.267641 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network c5332eb5-c186-4bcf-89d9-eb78be973548 details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:23:26.268429 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-70e65644-916e-4ef7-9ef9-d3843c01a9f1 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.271349 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Sync routers for ids ['13c2661f-fac1-483e-824d-3d28144d3cb6'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:23:26.286732 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a32b419-f305-4536-8327-ed3d7115adce admin admin] Made reservation on behalf of 46a1cb48de6e4f43a563f40fd92f0bf0 for: {'subnet': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:23:26.290109 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5a32b419-f305-4536-8327-ed3d7115adce admin admin] Publish callbacks [] for subnet, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.299214 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Routers {'13c2661f-fac1-483e-824d-3d28144d3cb6'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:26.300114 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['13c2661f-fac1-483e-824d-3d28144d3cb6'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:26.304999 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70e65644-916e-4ef7-9ef9-d3843c01a9f1 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e9d532e3-fe98-4b5a-8969-d424779060af,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:26.310739 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e163a4-fbe4-483f-aabe-6e8dfed0add5 req-a5a84413-9b68-4f00-beb0-1ef11adfc871 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:26.312751 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-53e163a4-fbe4-483f-aabe-6e8dfed0add5 req-a5a84413-9b68-4f00-beb0-1ef11adfc871 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 1098 time: 0.2236729 Nov 18 18:23:26.326070 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-70e65644-916e-4ef7-9ef9-d3843c01a9f1 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.328541 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-70e65644-916e-4ef7-9ef9-d3843c01a9f1 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3279841 Nov 18 18:23:26.333045 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 39132) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:26.346635 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-0a482bcb-ac0d-4e89-9c12-00c29480ff76 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Request body: {'security_group_rule': {'security_group_id': '7d840379-2de9-4453-883d-266a12b03984', 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:26.419219 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a54e80f8-d2a3-4967-a880-e54e5074d81a req-231ef658-5a6f-4579-843b-494cfea1a47a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1517322 Nov 18 18:23:26.464481 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0a482bcb-ac0d-4e89-9c12-00c29480ff76 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.488539 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 7338786c-8201-4395-989f-2f80d260bb87 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:26.489316 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.504602 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e163a4-fbe4-483f-aabe-6e8dfed0add5 req-a6109d02-d1aa-490d-8f7f-5f500a8051fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:26.506138 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-53e163a4-fbe4-483f-aabe-6e8dfed0add5 req-a6109d02-d1aa-490d-8f7f-5f500a8051fa service neutron] 10.222.0.31 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 921 time: 0.1565800 Nov 18 18:23:26.533731 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Set router 13c2661f-fac1-483e-824d-3d28144d3cb6 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:26.564859 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-53e163a4-fbe4-483f-aabe-6e8dfed0add5 req-2b26fdd5-0060-438f-a05f-c23b687593a7 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b627bee7-04b0-4a31-8ff0-84f976c65917 HTTP/1.1" status: 200 len: 217 time: 0.0486794 Nov 18 18:23:26.573187 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0a482bcb-ac0d-4e89-9c12-00c29480ff76 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.581664 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0a482bcb-ac0d-4e89-9c12-00c29480ff76 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.637463 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a482bcb-ac0d-4e89-9c12-00c29480ff76 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2ca7be63-2f74-4c96-a7de-109306a85699,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:26.657254 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0a482bcb-ac0d-4e89-9c12-00c29480ff76 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.658784 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-0a482bcb-ac0d-4e89-9c12-00c29480ff76 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3210521 Nov 18 18:23:26.660678 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e163a4-fbe4-483f-aabe-6e8dfed0add5 req-db0b6d91-756d-4775-8699-eba250cb043b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:26.661728 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39140) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:26.662301 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-53e163a4-fbe4-483f-aabe-6e8dfed0add5 req-db0b6d91-756d-4775-8699-eba250cb043b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 HTTP/1.1" status: 200 len: 859 time: 0.0863593 Nov 18 18:23:26.668781 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-4d5eb27b-eaa0-4c6f-ae08-1792241e9552 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Request body: {'security_group_rule': {'security_group_id': '7d840379-2de9-4453-883d-266a12b03984', 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:26.675762 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5a32b419-f305-4536-8327-ed3d7115adce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.709301 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-53e163a4-fbe4-483f-aabe-6e8dfed0add5 req-0e96b554-45f4-4c76-b74b-403cb37bc632 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0321999 Nov 18 18:23:26.751031 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a32b419-f305-4536-8327-ed3d7115adce admin admin] Pushing event updated for resources: {'Subnet': ['ID=24097eeb-7eeb-4617-b83d-a363de5de9b1,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:26.785600 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4d5eb27b-eaa0-4c6f-ae08-1792241e9552 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.809811 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a32b419-f305-4536-8327-ed3d7115adce admin admin] Checking segment: {'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:26.810168 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a32b419-f305-4536-8327-ed3d7115adce admin admin] Network hostable DHCP agents. Network: c5332eb5-c186-4bcf-89d9-eb78be973548, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102688) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:23:26.823630 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39154) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:26.870907 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a32b419-f305-4536-8327-ed3d7115adce admin admin] Network c5332eb5-c186-4bcf-89d9-eb78be973548 is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102688) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:23:26.892709 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-5a32b419-f305-4536-8327-ed3d7115adce admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, c5332eb5-c186-4bcf-89d9-eb78be973548) {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:26.904062 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4d5eb27b-eaa0-4c6f-ae08-1792241e9552 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.910893 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a32b419-f305-4536-8327-ed3d7115adce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:26.911583 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5a32b419-f305-4536-8327-ed3d7115adce admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.916818 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4d5eb27b-eaa0-4c6f-ae08-1792241e9552 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.930725 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ff9778e-48c0-49c0-ac6f-e7fd00a50506 None None] Network c5332eb5-c186-4bcf-89d9-eb78be973548 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:23:26.949580 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d5eb27b-eaa0-4c6f-ae08-1792241e9552 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9bd35bb7-c053-46ca-9614-7e2dbf4cc7bd,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:26.963253 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-5a32b419-f305-4536-8327-ed3d7115adce admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.7140665 Nov 18 18:23:26.968374 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4d5eb27b-eaa0-4c6f-ae08-1792241e9552 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:26.969590 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-4d5eb27b-eaa0-4c6f-ae08-1792241e9552 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3060215 Nov 18 18:23:26.970146 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39158) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:26.974409 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 39162) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:26.975538 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:26.986699 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-de813569-de2f-47f8-bfbb-8f34a25222a3 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Request body: {'security_group_rule': {'security_group_id': '7d840379-2de9-4453-883d-266a12b03984', 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:27.007022 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-53e163a4-fbe4-483f-aabe-6e8dfed0add5 req-37d1a49e-6cd7-42c0-b20f-3ea6e861a34f service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2808714 Nov 18 18:23:27.021292 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-430558', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-543'] for router, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.022460 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-430410', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-500004', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1631324', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-534'] for router, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.028407 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-132052aa-d469-4cc9-9f97-b6c061180522 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.062888 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-de813569-de2f-47f8-bfbb-8f34a25222a3 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.077310 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-43b7ff26-4858-4004-8861-9d7288bfe8f4 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:27.078903 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-43b7ff26-4858-4004-8861-9d7288bfe8f4 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 815 time: 0.2317448 Nov 18 18:23:27.148331 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device d070011f-e438-4b08-b097-5cac8c261ba4 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:23:27.175650 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'name': 'tempest-TestShelveInstance-820423817-router', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65'}], 'enable_snat': True}, 'gw_port_id': '7338786c-8201-4395-989f-2f80d260bb87', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:18Z', 'updated_at': '2021-11-18T18:23:23Z', 'revision_number': 4, 'project_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'gw_port': {'id': '7338786c-8201-4395-989f-2f80d260bb87', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:6c:fe:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:19Z', 'updated_at': '2021-11-18T18:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'aa9da10c-d74d-4dc3-99c9-055b24cc4110', 'name': '', 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'mac_address': 'fa:16:3e:c6:9a:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': 'cd3ac6d9-a01b-4af0-8cf6-bc22a308025d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:22Z', 'updated_at': '2021-11-18T18:23:23Z', 'revision_number': 2, 'project_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'subnets': [{'id': 'cd3ac6d9-a01b-4af0-8cf6-bc22a308025d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:27.182026 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc1c763e3-2102-51f8-97fe-c751e57774c1-c5332eb5-c186-4bcf-89d9-eb78be973548', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'fixed_ips': [{'subnet_id': '24097eeb-7eeb-4617-b83d-a363de5de9b1'}]}} from dv-cinder-787764-6-iscsi. {{(pid=102690) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 18:23:27.182900 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.200065 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ab1e244a-eecc-4e20-ac7e-e5fd01107bd2 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/quotas/eed6400cd0414bc5a520c9886c2a4bde HTTP/1.1" status: 200 len: 375 time: 0.1065249 Nov 18 18:23:27.227487 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Checking router: 13c2661f-fac1-483e-824d-3d28144d3cb6 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:23:27.227848 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Updating router 13c2661f-fac1-483e-824d-3d28144d3cb6 port aa9da10c-d74d-4dc3-99c9-055b24cc4110 binding host dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:23:27.265367 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb5a6e0c-a3a3-4273-a0cb-416b3a9be1e3 req-355d1910-1f01-4db0-b1a5-78bf4695d2b3 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:27.266892 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eb5a6e0c-a3a3-4273-a0cb-416b3a9be1e3 req-355d1910-1f01-4db0-b1a5-78bf4695d2b3 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 943 time: 0.1999652 Nov 18 18:23:27.306442 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-53e163a4-fbe4-483f-aabe-6e8dfed0add5 req-3ec637c2-6d30-4c5a-a407-c3ff8e0cdb7c service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2734954 Nov 18 18:23:27.314218 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.314837 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-de813569-de2f-47f8-bfbb-8f34a25222a3 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.341358 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-793eedf1-250e-4f7c-b736-53b4ca9efb5d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1284707 Nov 18 18:23:27.342059 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-de813569-de2f-47f8-bfbb-8f34a25222a3 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.369070 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.381638 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de813569-de2f-47f8-bfbb-8f34a25222a3 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=df54980d-96ec-4ac9-a734-166dbaf1faf4,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:27.402007 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-de813569-de2f-47f8-bfbb-8f34a25222a3 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.403634 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-de813569-de2f-47f8-bfbb-8f34a25222a3 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4238625 Nov 18 18:23:27.417122 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 39168) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:27.426110 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-945b0ce2-80f6-450d-a96c-fd38f5c5ac19 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Request body: {'security_group_rule': {'security_group_id': '7d840379-2de9-4453-883d-266a12b03984', 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:27.429667 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-132052aa-d469-4cc9-9f97-b6c061180522 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.446556 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eb5a6e0c-a3a3-4273-a0cb-416b3a9be1e3 req-82a792c1-6252-4949-8759-16016215706e tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1581426 Nov 18 18:23:27.447781 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port d070011f-e438-4b08-b097-5cac8c261ba4, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=d070011f-e438-4b08-b097-5cac8c261ba4,segment=NetworkSegment(d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20),segment_id=d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:27.465220 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-132052aa-d469-4cc9-9f97-b6c061180522 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.518299 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.521249 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.securitygroups_db [None req-945b0ce2-80f6-450d-a96c-fd38f5c5ac19 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Project 029e580af1e3498aa00c86f5ce660a80 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 18 18:23:27.532653 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': 'd070011f-e438-4b08-b097-5cac8c261ba4', 'network_id': 'f06fa801-dbf4-454b-984e-82c11cc6c900', 'port_id': 'd070011f-e438-4b08-b097-5cac8c261ba4', 'mac_address': 'fa:16:3e:ce:ff:20', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1333, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd477b94e-c409-446d-9434-db6811cbe863', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:23:27.534724 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-945b0ce2-80f6-450d-a96c-fd38f5c5ac19 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.547176 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-132052aa-d469-4cc9-9f97-b6c061180522 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1bc879bf095a467386db7ae032d0068a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7188740 Nov 18 18:23:27.547420 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 39172) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:27.559270 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-132052aa-d469-4cc9-9f97-b6c061180522 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e3c95c2f-bf48-40c8-9147-fbca3a9c38bb,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:27.579475 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-0bde8c25-00b6-4802-a2d4-3487a44ba1bd service neutron] 10.222.0.82 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2045724 Nov 18 18:23:27.639475 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.db_base_plugin_common [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Allocated IP 172.20.0.2 (c5332eb5-c186-4bcf-89d9-eb78be973548/24097eeb-7eeb-4617-b83d-a363de5de9b1/18e6fda8-f433-4a69-be2a-ef1bb908d69b) {{(pid=102690) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:27.694898 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.733625 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-945b0ce2-80f6-450d-a96c-fd38f5c5ac19 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.740154 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d070011f-e438-4b08-b097-5cac8c261ba4 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:23:27.745158 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-945b0ce2-80f6-450d-a96c-fd38f5c5ac19 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.757077 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.763536 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-85ccc16a-cd95-4da9-9b3e-e3c34b9a33fd service neutron] 10.222.0.82 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1739497 Nov 18 18:23:27.775523 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78e534ad-4a9d-4c2d-8887-6d9d84bcfd4d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.781702 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.846845 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-945b0ce2-80f6-450d-a96c-fd38f5c5ac19 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0638aeaf-ef2e-4ffb-9034-acdd3bdec3fd,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:27.857822 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-945b0ce2-80f6-450d-a96c-fd38f5c5ac19 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.861548 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-945b0ce2-80f6-450d-a96c-fd38f5c5ac19 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4405243 Nov 18 18:23:27.861820 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port d070011f-e438-4b08-b097-5cac8c261ba4, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=d070011f-e438-4b08-b097-5cac8c261ba4,segment=NetworkSegment(d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20),segment_id=d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:27.864412 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39174) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:27.869980 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-4d1e6938-2349-43c6-8af3-12d9370f0c6c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Request body: {'security_group_rule': {'security_group_id': '7d840379-2de9-4453-883d-266a12b03984', 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:27.878730 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78e534ad-4a9d-4c2d-8887-6d9d84bcfd4d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.879205 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.925268 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.securitygroups_db [None req-4d1e6938-2349-43c6-8af3-12d9370f0c6c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Project 029e580af1e3498aa00c86f5ce660a80 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 18 18:23:27.939276 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4d1e6938-2349-43c6-8af3-12d9370f0c6c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.945932 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed1b9e1-e490-45b5-a454-50ff5ada3852 req-e2a7842f-5cd0-4e85-b30e-84921469a566 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:27.947523 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1ed1b9e1-e490-45b5-a454-50ff5ada3852 req-e2a7842f-5cd0-4e85-b30e-84921469a566 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1088948 Nov 18 18:23:27.984801 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78e534ad-4a9d-4c2d-8887-6d9d84bcfd4d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.988252 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78e534ad-4a9d-4c2d-8887-6d9d84bcfd4d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:27.992843 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-78e534ad-4a9d-4c2d-8887-6d9d84bcfd4d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e3c95c2f-bf48-40c8-9147-fbca3a9c38bb HTTP/1.1" status: 204 len: 168 time: 0.4444799 Nov 18 18:23:28.014458 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78e534ad-4a9d-4c2d-8887-6d9d84bcfd4d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3c95c2f-bf48-40c8-9147-fbca3a9c38bb,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:28.016889 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=d070011f-e438-4b08-b097-5cac8c261ba4,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:28.062596 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc39e1c9-0b68-4bed-8c3c-6543a7e61392 req-462fe6aa-e0de-4d37-8a27-7d1709a80ff2 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 210 time: 0.0427103 Nov 18 18:23:28.073235 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Publish callbacks [] for port, precommit_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.094654 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4d1e6938-2349-43c6-8af3-12d9370f0c6c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.099328 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Publish callbacks [] for port, precommit_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.101960 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.106145 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4d1e6938-2349-43c6-8af3-12d9370f0c6c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.110270 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1ed1b9e1-e490-45b5-a454-50ff5ada3852 req-26445a7b-5607-461c-924d-78c42f53242a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1358199 Nov 18 18:23:28.125932 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Allocated IP 172.27.1.137 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/79ca7317-593f-4234-aa06-60a8ba1fdb61) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:28.160986 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.161375 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d1e6938-2349-43c6-8af3-12d9370f0c6c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d1ebf876-c6ab-4c93-b61a-3311909b1166,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:28.177459 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Network c5332eb5-c186-4bcf-89d9-eb78be973548 is already hosted by enough agents. {{(pid=102690) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:28.179407 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4d1e6938-2349-43c6-8af3-12d9370f0c6c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.181460 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-4d1e6938-2349-43c6-8af3-12d9370f0c6c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3146784 Nov 18 18:23:28.185616 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.base_scheduler [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Resources bound (agent type, host, resource id): {{(pid=102690) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:28.188047 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Received port after_create {{(pid=102690) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:28.261606 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Pushing event updated for resources: {'Port': ['ID=18e6fda8-f433-4a69-be2a-ef1bb908d69b,revision_number=1']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:28.292687 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['d070011f-e438-4b08-b097-5cac8c261ba4'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:23:28.344137 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.417855 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.470727 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:28.474088 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:28.476690 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:28.483142 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fb8a3ae-bdaf-4ecb-968d-15c30265d3d6 None None] Pushing event updated for resources: {'Port': ['ID=aa9da10c-d74d-4dc3-99c9-055b24cc4110,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:28.521173 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Attempting to bind port 18e6fda8-f433-4a69-be2a-ef1bb908d69b on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:28.521769 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Attempting to bind port 18e6fda8-f433-4a69-be2a-ef1bb908d69b by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:28.522344 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Attempting to bind port 18e6fda8-f433-4a69-be2a-ef1bb908d69b on network c5332eb5-c186-4bcf-89d9-eb78be973548 {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:28.529520 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Pushing event updated for resources: {'Port': ['ID=79ca7317-593f-4234-aa06-60a8ba1fdb61,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:28.544263 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:28.545268 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Checking segment: {'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:28.545929 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.546500 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Bound using segment: {'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:28.547328 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Bound port: 18e6fda8-f433-4a69-be2a-ef1bb908d69b, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:28.549279 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.571897 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Attempting to bind port aa9da10c-d74d-4dc3-99c9-055b24cc4110 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:28.572703 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Attempting to bind port aa9da10c-d74d-4dc3-99c9-055b24cc4110 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '184d64c9-8049-408c-9e5a-54f72d13ce49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1330, 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:28.573247 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Attempting to bind port aa9da10c-d74d-4dc3-99c9-055b24cc4110 on network f961cc50-11d6-4545-80f0-cb15e6b8881d {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:28.586417 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 39220) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:28.598141 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:28.598710 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Checking segment: {'id': '184d64c9-8049-408c-9e5a-54f72d13ce49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1330, 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:28.599267 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.599835 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Bound using segment: {'id': '184d64c9-8049-408c-9e5a-54f72d13ce49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1330, 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:28.600571 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Bound port: aa9da10c-d74d-4dc3-99c9-055b24cc4110, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '184d64c9-8049-408c-9e5a-54f72d13ce49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1330, 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:28.601145 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.675614 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-f0e687ec-5e7b-45bb-874a-71b70c1b3b40 None None] Provisioning complete for port aa9da10c-d74d-4dc3-99c9-055b24cc4110 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:28.676373 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f0e687ec-5e7b-45bb-874a-71b70c1b3b40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.794589 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] For port 18e6fda8-f433-4a69-be2a-ef1bb908d69b, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:28.812659 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] For port 18e6fda8-f433-4a69-be2a-ef1bb908d69b, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=18e6fda8-f433-4a69-be2a-ef1bb908d69b,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:28.816634 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-f0e687ec-5e7b-45bb-874a-71b70c1b3b40 None None] Port aa9da10c-d74d-4dc3-99c9-055b24cc4110 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:23:28.830588 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.846767 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] For port aa9da10c-d74d-4dc3-99c9-055b24cc4110, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:28.875869 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.889235 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] For port aa9da10c-d74d-4dc3-99c9-055b24cc4110, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=aa9da10c-d74d-4dc3-99c9-055b24cc4110,segment=NetworkSegment(184d64c9-8049-408c-9e5a-54f72d13ce49),segment_id=184d64c9-8049-408c-9e5a-54f72d13ce49)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:28.911701 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:28.996970 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fbf73a3-e638-4c34-a591-822119ebd5b9 None None] Pushing event updated for resources: {'Port': ['ID=18e6fda8-f433-4a69-be2a-ef1bb908d69b,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:29.032801 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4620ca24-9d6c-4854-8b5c-1af45d63346a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:29.104808 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Routers {'13c2661f-fac1-483e-824d-3d28144d3cb6'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:29.105699 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['13c2661f-fac1-483e-824d-3d28144d3cb6'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:29.363544 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-430421', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-500439'] for router, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:29.368295 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4620ca24-9d6c-4854-8b5c-1af45d63346a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:29.407331 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4620ca24-9d6c-4854-8b5c-1af45d63346a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:29.515297 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c7f7553a-3b1f-4d92-9eee-f56fdb233447 req-ff22093a-0780-4e8d-9e5c-6689c3c5e717 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 210 time: 0.1445966 Nov 18 18:23:29.543272 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-4620ca24-9d6c-4854-8b5c-1af45d63346a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=fcee3488d805490881b0b647d8a898d7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9524155 Nov 18 18:23:29.550146 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 39246) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:29.604270 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Router e8464c87-c9dc-43f0-9906-eda0c4a24cdb is scheduled to L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 with binding_index 1 {{(pid=102688) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 18:23:29.620399 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9402b330-ba0d-4481-84f9-1bc71d684372 req-3dbdebae-5ab4-4274-87ca-dcdd7dcdb781 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:29.632532 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9402b330-ba0d-4481-84f9-1bc71d684372 req-3dbdebae-5ab4-4274-87ca-dcdd7dcdb781 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 944 time: 0.6113670 Nov 18 18:23:29.651219 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4620ca24-9d6c-4854-8b5c-1af45d63346a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61dfe43a-d0ee-4f56-8a33-2480c4bac733,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:29.713209 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] Set router 13c2661f-fac1-483e-824d-3d28144d3cb6 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:29.807659 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9402b330-ba0d-4481-84f9-1bc71d684372 req-a4b6301b-b8e4-4b37-a2ca-fe1bcd128858 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1662583 Nov 18 18:23:29.851036 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9a9a9194-aaa8-4ccb-8898-427fd32f46f3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:29.873413 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8239af57-15ec-4d1b-a3d8-3b221b8e4d2f req-f7647f9e-e8f4-4c61-8b0b-417f9e5fbc8c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:29.875452 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-e143cd47-72ae-49e7-a5f6-d326cf03f4e0 None None] Provisioning complete for port aa9da10c-d74d-4dc3-99c9-055b24cc4110 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:29.875833 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e143cd47-72ae-49e7-a5f6-d326cf03f4e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:29.882192 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8239af57-15ec-4d1b-a3d8-3b221b8e4d2f req-f7647f9e-e8f4-4c61-8b0b-417f9e5fbc8c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.2391517 Nov 18 18:23:29.917199 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9a9a9194-aaa8-4ccb-8898-427fd32f46f3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:29.931872 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:23:29.942358 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Sync routers for ids ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:23:29.958963 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Routers {'e8464c87-c9dc-43f0-9906-eda0c4a24cdb'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:29.959634 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:29.960338 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] Publish callbacks [] for router, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:29.964000 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-3ddc7326-2fc0-45de-8a65-67e5b0af49b1 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.9922428 Nov 18 18:23:29.968550 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39268) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:30.010404 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fb8a3ae-bdaf-4ecb-968d-15c30265d3d6 None None] Pushing event updated for resources: {'Port': ['ID=aa9da10c-d74d-4dc3-99c9-055b24cc4110,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:30.043907 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8239af57-15ec-4d1b-a3d8-3b221b8e4d2f req-1a9dea1e-3a9b-4ce0-a74b-0e99c6740987 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1606624 Nov 18 18:23:30.098689 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9a9a9194-aaa8-4ccb-8898-427fd32f46f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:30.101560 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9a9a9194-aaa8-4ccb-8898-427fd32f46f3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:30.109042 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-9a9a9194-aaa8-4ccb-8898-427fd32f46f3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/61dfe43a-d0ee-4f56-8a33-2480c4bac733 HTTP/1.1" status: 204 len: 168 time: 0.5516038 Nov 18 18:23:30.109687 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Set router e8464c87-c9dc-43f0-9906-eda0c4a24cdb gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:30.117219 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a9a9194-aaa8-4ccb-8898-427fd32f46f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61dfe43a-d0ee-4f56-8a33-2480c4bac733,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:30.176562 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e143cd47-72ae-49e7-a5f6-d326cf03f4e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:30.223622 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'name': 'tempest-TestShelveInstance-820423817-router', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65'}], 'enable_snat': True}, 'gw_port_id': '7338786c-8201-4395-989f-2f80d260bb87', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:18Z', 'updated_at': '2021-11-18T18:23:23Z', 'revision_number': 4, 'project_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'gw_port': {'id': '7338786c-8201-4395-989f-2f80d260bb87', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:6c:fe:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:19Z', 'updated_at': '2021-11-18T18:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'aa9da10c-d74d-4dc3-99c9-055b24cc4110', 'name': '', 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'mac_address': 'fa:16:3e:c6:9a:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': 'cd3ac6d9-a01b-4af0-8cf6-bc22a308025d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:22Z', 'updated_at': '2021-11-18T18:23:28Z', 'revision_number': 4, 'project_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'subnets': [{'id': 'cd3ac6d9-a01b-4af0-8cf6-bc22a308025d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:30.264805 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-881b0a64-54d3-47d8-8357-19c2b31d3cab None None] The sync data for ids ['13c2661f-fac1-483e-824d-3d28144d3cb6'] in dv-cinder-787764-6-iscsi is: [{'id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'name': 'tempest-TestShelveInstance-820423817-router', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65'}], 'enable_snat': True}, 'gw_port_id': '7338786c-8201-4395-989f-2f80d260bb87', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:18Z', 'updated_at': '2021-11-18T18:23:23Z', 'revision_number': 4, 'project_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'gw_port': {'id': '7338786c-8201-4395-989f-2f80d260bb87', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:6c:fe:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:19Z', 'updated_at': '2021-11-18T18:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'aa9da10c-d74d-4dc3-99c9-055b24cc4110', 'name': '', 'network_id': 'f961cc50-11d6-4545-80f0-cb15e6b8881d', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'mac_address': 'fa:16:3e:c6:9a:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': 'cd3ac6d9-a01b-4af0-8cf6-bc22a308025d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:22Z', 'updated_at': '2021-11-18T18:23:28Z', 'revision_number': 4, 'project_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'subnets': [{'id': 'cd3ac6d9-a01b-4af0-8cf6-bc22a308025d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:23:30.270811 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-e143cd47-72ae-49e7-a5f6-d326cf03f4e0 None None] For port aa9da10c-d74d-4dc3-99c9-055b24cc4110, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=aa9da10c-d74d-4dc3-99c9-055b24cc4110,segment=NetworkSegment(184d64c9-8049-408c-9e5a-54f72d13ce49),segment_id=184d64c9-8049-408c-9e5a-54f72d13ce49)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:30.282028 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e143cd47-72ae-49e7-a5f6-d326cf03f4e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:30.385378 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e143cd47-72ae-49e7-a5f6-d326cf03f4e0 None None] Pushing event updated for resources: {'Port': ['ID=aa9da10c-d74d-4dc3-99c9-055b24cc4110,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:30.463310 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 18e6fda8-f433-4a69-be2a-ef1bb908d69b up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:30.622904 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 18e6fda8-f433-4a69-be2a-ef1bb908d69b triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:30.623514 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:30.690144 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-f31aa7d7-81b6-43d6-835e-b040ef753efe tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:30.691729 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-f31aa7d7-81b6-43d6-835e-b040ef753efe tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 815 time: 0.2759647 Nov 18 18:23:30.756679 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Request body: {'port': {'device_id': '8694df99-13ee-45f4-b82d-23add3f16c40', 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1', 'admin_state_up': True, 'tenant_id': 'eed6400cd0414bc5a520c9886c2a4bde'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:30.788749 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ec37fd1-99b7-4776-b2a6-92e7dc6fff2d None None] Network c5332eb5-c186-4bcf-89d9-eb78be973548 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:23:30.861929 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e213937e-8e79-44d3-94fb-b0ffbebf0caa req-1228295f-13f8-4197-9b82-1baa79d5c1ae tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 210 time: 0.1532583 Nov 18 18:23:30.910717 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:28Z', 'revision_number': 3, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:28Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:30.942153 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Checking router: e8464c87-c9dc-43f0-9906-eda0c4a24cdb for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:23:30.942930 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Updating router e8464c87-c9dc-43f0-9906-eda0c4a24cdb port 79ca7317-593f-4234-aa06-60a8ba1fdb61 binding host dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:23:30.973414 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.001332 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.052850 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-aab9a1b7-6485-4e83-b005-30234b3eb545 None None] Provisioning complete for port 18e6fda8-f433-4a69-be2a-ef1bb908d69b triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:31.053264 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-aab9a1b7-6485-4e83-b005-30234b3eb545 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.160897 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device d070011f-e438-4b08-b097-5cac8c261ba4 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:31.277253 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Made reservation on behalf of eed6400cd0414bc5a520c9886c2a4bde for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:23:31.290337 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.327585 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port 18e6fda8-f433-4a69-be2a-ef1bb908d69b, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=18e6fda8-f433-4a69-be2a-ef1bb908d69b,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:31.330044 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Publish callbacks [] for port, precommit_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.332795 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-aab9a1b7-6485-4e83-b005-30234b3eb545 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.349649 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.354698 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.390973 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6611eb-e899-4be8-b48b-84524fc2016d req-5d8487e4-f3e2-4dd7-b2ef-81b4894ca6fb tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:31.397715 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2b6611eb-e899-4be8-b48b-84524fc2016d req-5d8487e4-f3e2-4dd7-b2ef-81b4894ca6fb tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 944 time: 0.4211669 Nov 18 18:23:31.408298 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5375aa6c-05fe-47f7-a18e-90c64e8dc6e7 None None] Pushing event updated for resources: {'Port': ['ID=79ca7317-593f-4234-aa06-60a8ba1fdb61,revision_number=2']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:31.437909 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Attempting to bind port 79ca7317-593f-4234-aa06-60a8ba1fdb61 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:31.438370 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Attempting to bind port 79ca7317-593f-4234-aa06-60a8ba1fdb61 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:31.438930 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Attempting to bind port 79ca7317-593f-4234-aa06-60a8ba1fdb61 on network 2cab888d-52a8-434c-814e-4f25740decd0 {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:31.446317 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:31.446698 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Checking segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102691) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:31.447107 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.447509 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Bound using segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:31.448276 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Bound port: 79ca7317-593f-4234-aa06-60a8ba1fdb61, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:31.448814 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.451460 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.498665 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2b6611eb-e899-4be8-b48b-84524fc2016d req-efc8a60b-4b47-4cde-9507-73826e420d9e tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0890727 Nov 18 18:23:31.537912 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] For port 79ca7317-593f-4234-aa06-60a8ba1fdb61, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102691) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:31.553789 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] For port 79ca7317-593f-4234-aa06-60a8ba1fdb61, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=79ca7317-593f-4234-aa06-60a8ba1fdb61,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102691) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:31.560053 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=18e6fda8-f433-4a69-be2a-ef1bb908d69b,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:31.565063 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.db.api [None req-aab9a1b7-6485-4e83-b005-30234b3eb545 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102690) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 18 18:23:31.565478 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG oslo_db.api [None req-aab9a1b7-6485-4e83-b005-30234b3eb545 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 18 18:23:31.570832 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.573056 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port d070011f-e438-4b08-b097-5cac8c261ba4 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:23:31.580701 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port d070011f-e438-4b08-b097-5cac8c261ba4 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:31.580701 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.661368 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c958980-073e-4d74-953b-3447d26d991b req-9d242486-1f98-4fef-ba47-e4a9fff1f82c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:31.668902 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c958980-073e-4d74-953b-3447d26d991b req-9d242486-1f98-4fef-ba47-e4a9fff1f82c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.4784043 Nov 18 18:23:31.694574 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5375aa6c-05fe-47f7-a18e-90c64e8dc6e7 None None] Pushing event updated for resources: {'Port': ['ID=79ca7317-593f-4234-aa06-60a8ba1fdb61,revision_number=3']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:31.748583 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Routers {'e8464c87-c9dc-43f0-9906-eda0c4a24cdb'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:31.749514 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:31.809751 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c958980-073e-4d74-953b-3447d26d991b req-56003277-60ef-46b2-be31-aab39e47992a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1392632 Nov 18 18:23:31.811669 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:31.870212 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Allocated IP 172.20.0.1 (c5332eb5-c186-4bcf-89d9-eb78be973548/24097eeb-7eeb-4617-b83d-a363de5de9b1/6401bf2f-1763-4e1c-9200-1fa1bff41750) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:31.910016 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '619976bf-fa6c-40cd-a53b-d98f17befea6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd070011f-e438-4b08-b097-5cac8c261ba4'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:23:31.914545 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-737771f8-2b22-465f-984c-aa234c3a63ee" -d '{"events": [{"server_uuid": "619976bf-fa6c-40cd-a53b-d98f17befea6", "name": "network-vif-plugged", "status": "completed", "tag": "d070011f-e438-4b08-b097-5cac8c261ba4"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:23:31.957101 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Allocated IP 172.20.0.11 (14ac84aa-8c04-4323-8592-aecfbb5a7fe1/488ef4e4-e6f9-414a-b93f-aabd7b232f9e/7f5eeb8c-4f5d-4aff-8212-8c2f004ba255) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:31.970085 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port d070011f-e438-4b08-b097-5cac8c261ba4, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=d070011f-e438-4b08-b097-5cac8c261ba4,segment=NetworkSegment(d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20),segment_id=d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:31.985200 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:32.163675 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] Set router e8464c87-c9dc-43f0-9906-eda0c4a24cdb gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:32.183161 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e0689e9e-c420-4aaf-840f-ee926273ad6d req-04912cc0-4792-4afc-b5f4-89f0c7d9f810 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 210 time: 0.1169939 Nov 18 18:23:32.282814 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:32.331023 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=d070011f-e438-4b08-b097-5cac8c261ba4,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:32.362508 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:23:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-90352ede-2ef3-46f2-8eae-0428e778ec96 x-openstack-request-id: req-90352ede-2ef3-46f2-8eae-0428e778ec96 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:23:32.362809 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "619976bf-fa6c-40cd-a53b-d98f17befea6", "name": "network-vif-plugged", "status": "completed", "tag": "d070011f-e438-4b08-b097-5cac8c261ba4", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:23:32.363679 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-90352ede-2ef3-46f2-8eae-0428e778ec96 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:23:32.364110 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '619976bf-fa6c-40cd-a53b-d98f17befea6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd070011f-e438-4b08-b097-5cac8c261ba4', 'code': 200} Nov 18 18:23:32.393309 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-914ce9b0-fed9-4ffb-816a-6c13993abd5b None None] Provisioning complete for port 18e6fda8-f433-4a69-be2a-ef1bb908d69b triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:32.393690 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-914ce9b0-fed9-4ffb-816a-6c13993abd5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:32.507195 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:32.585912 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 18e6fda8-f433-4a69-be2a-ef1bb908d69b up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:32.601353 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:32.655358 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:28Z', 'revision_number': 3, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:32.675530 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 18e6fda8-f433-4a69-be2a-ef1bb908d69b triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:32.675900 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:32.706142 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Network c5332eb5-c186-4bcf-89d9-eb78be973548 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:32.728440 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:32.769859 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:32.770365 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-500260'] for router_interface, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:32.815109 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dbb32fbc-e4ad-4087-bfa9-e75288600039 None None] The sync data for ids ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'] in dv-cinder-787764-6-iscsi is: [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:28Z', 'revision_number': 3, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:23:32.855459 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5920c65-d7b7-4fd0-8e5d-3fd1c5a72087 req-9ff7a0da-7328-48b5-adb5-8f77889eb4b9 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:32.863279 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e5920c65-d7b7-4fd0-8e5d-3fd1c5a72087 req-9ff7a0da-7328-48b5-adb5-8f77889eb4b9 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 945 time: 0.1706221 Nov 18 18:23:32.894633 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:32.924737 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device aa9da10c-d74d-4dc3-99c9-055b24cc4110 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:32.938380 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Pushing event updated for resources: {'Port': ['ID=6401bf2f-1763-4e1c-9200-1fa1bff41750,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:32.964782 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['f3483de4-481b-47ac-8d51-f8457fd0bb85', '1b418eab-96c7-4da9-ba41-6e91026f7285', '6c7a2d7a-25d2-4642-b407-868695446a27'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:23:32.974965 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a11334c-0fd5-42cf-a876-9c91e62cc4dd req-97c7f563-9a15-408b-9397-d15f6167cefe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:32.977603 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-3a11334c-0fd5-42cf-a876-9c91e62cc4dd req-97c7f563-9a15-408b-9397-d15f6167cefe service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 1098 time: 0.1198475 Nov 18 18:23:33.059056 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:33.088632 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Pushing event updated for resources: {'Port': ['ID=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:33.098850 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:33.110620 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:33.123059 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-3a11334c-0fd5-42cf-a876-9c91e62cc4dd req-84e25089-1d69-41ff-8d49-bd5690713f1f service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1209407 Nov 18 18:23:33.157027 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:33.330996 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:33.332224 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:33.339662 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port aa9da10c-d74d-4dc3-99c9-055b24cc4110 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:33.340058 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:33.370733 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e5920c65-d7b7-4fd0-8e5d-3fd1c5a72087 req-c7c9514b-9331-4b37-9b08-d08ef7529f77 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5066013 Nov 18 18:23:33.423608 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-a4f05f2b-6441-4130-8c6d-8019ad09bde6 None None] Provisioning complete for port 6401bf2f-1763-4e1c-9200-1fa1bff41750 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:33.424056 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a4f05f2b-6441-4130-8c6d-8019ad09bde6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:33.425127 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ddba4337-3527-471f-8615-a4fc8715bc6e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.6793420 Nov 18 18:23:33.444190 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:33.452710 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:33.454955 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1772530', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-499092'] for router_interface, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:33.455262 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Request body: {'port': {'device_id': '8694df99-13ee-45f4-b82d-23add3f16c40', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:33.484650 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089457b1-d1ba-4081-bea0-4f58d501314b req-09ede49d-afaf-4eb1-bab1-fd383ba50aed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:33.489967 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-089457b1-d1ba-4081-bea0-4f58d501314b req-09ede49d-afaf-4eb1-bab1-fd383ba50aed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1537056 Nov 18 18:23:33.517217 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Pushing event updated for resources: {'Port': ['ID=6401bf2f-1763-4e1c-9200-1fa1bff41750,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:33.676440 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-a4f05f2b-6441-4130-8c6d-8019ad09bde6 None None] Port 6401bf2f-1763-4e1c-9200-1fa1bff41750 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:23:33.710451 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Network c5332eb5-c186-4bcf-89d9-eb78be973548 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:33.712401 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:33.829433 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:33.837684 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-089457b1-d1ba-4081-bea0-4f58d501314b req-2859fac5-3fae-48ab-8259-25ca132f4461 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2707603 Nov 18 18:23:33.852852 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5bbd4e-1c86-4da0-877b-d416069c40d6 req-034f0df4-d6f9-4642-8cdd-793df240d368 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:33.861111 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3f5bbd4e-1c86-4da0-877b-d416069c40d6 req-034f0df4-d6f9-4642-8cdd-793df240d368 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 932 time: 0.2868748 Nov 18 18:23:33.979292 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Router e8464c87-c9dc-43f0-9906-eda0c4a24cdb has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102688) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:23:33.999268 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-cf8e95d0-e28c-41a5-865c-629281fbd245 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:34.000507 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3f5bbd4e-1c86-4da0-877b-d416069c40d6 req-0a3f09d1-319f-46b0-8144-0ee7c6961620 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1382904 Nov 18 18:23:34.107862 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-c2c86f16-bc54-44bc-be61-8bfae619bdea None None] Provisioning complete for port 6401bf2f-1763-4e1c-9200-1fa1bff41750 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:34.108513 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-c2c86f16-bc54-44bc-be61-8bfae619bdea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:34.148652 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9677853-538e-48cb-9ffb-1ac962fb7427 req-992c28b2-979c-4ee5-af11-d7cdc6c1e6fe tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:34.150268 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b9677853-538e-48cb-9ffb-1ac962fb7427 req-992c28b2-979c-4ee5-af11-d7cdc6c1e6fe tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1464109 Nov 18 18:23:34.165088 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-c2c86f16-bc54-44bc-be61-8bfae619bdea None None] Port 6401bf2f-1763-4e1c-9200-1fa1bff41750 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:23:34.213586 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:23:34.220710 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-f1205969-fec8-4cf2-9e5d-1b6cc27f8e22 admin admin] 10.222.0.82 "PUT /v2.0/routers/e8464c87-c9dc-43f0-9906-eda0c4a24cdb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2506623 Nov 18 18:23:34.313692 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 79ca7317-593f-4234-aa06-60a8ba1fdb61 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:34.315767 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b9677853-538e-48cb-9ffb-1ac962fb7427 req-c45c18b4-211c-466b-b60b-35bea0593c6e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1516201 Nov 18 18:23:34.443566 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 79ca7317-593f-4234-aa06-60a8ba1fdb61 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:34.449716 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:34.471276 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:23:34.491149 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:34.533492 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Transition to ACTIVE for port object 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:23:34.556892 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:34.680395 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Pushing event updated for resources: {'Port': ['ID=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:34.704239 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca031f9-b19d-42f7-8c8a-838a6c5f9c35 req-63122752-de45-4654-8290-ac3ce5703b51 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:34.712250 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3ca031f9-b19d-42f7-8c8a-838a6c5f9c35 req-63122752-de45-4654-8290-ac3ce5703b51 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 945 time: 0.1745961 Nov 18 18:23:34.835262 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3ca031f9-b19d-42f7-8c8a-838a6c5f9c35 req-bbf3ba60-9eca-4eac-8f15-7de50507d5ed tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1164942 Nov 18 18:23:34.840936 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:34.862441 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Attempting to bind port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:34.862692 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Attempting to bind port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:34.863381 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Attempting to bind port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 on network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:34.868716 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 on network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:23:34.869038 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Attempting to bind port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 on network 14ac84aa-8c04-4323-8592-aecfbb5a7fe1 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:34.874458 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:34.874795 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Checking segment: {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:34.875177 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Bound using segment: {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:34.875602 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Bound port: 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2ba9981f-6a4d-4618-9c8c-84315de87d1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1303, 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:34.876093 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:34.882361 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port 79ca7317-593f-4234-aa06-60a8ba1fdb61, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=79ca7317-593f-4234-aa06-60a8ba1fdb61,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:34.892876 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.061267 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=79ca7317-593f-4234-aa06-60a8ba1fdb61,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:35.091666 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] For port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:35.159956 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] For port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:35.198010 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.311455 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39426) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:35.317152 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b20098-7564-4f06-b7c6-b72e14ecc905 req-9e11a389-178c-4718-b608-22f96046ab39 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:35.317907 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-746634804-network', 'tenant_id': '165504901a854a98988fc6ac8b063e92'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:35.318742 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-79b20098-7564-4f06-b7c6-b72e14ecc905 req-9e11a389-178c-4718-b608-22f96046ab39 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.2720914 Nov 18 18:23:35.323992 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Pushing event updated for resources: {'Port': ['ID=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:35.327107 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:35.327860 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.329132 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-391a3166-3012-4e22-96e3-77e4bd4accad service neutron] 10.222.0.31 "PUT /v2.0/ports/7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 HTTP/1.1" status: 200 len: 1094 time: 1.8818388 Nov 18 18:23:35.329743 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8694df99-13ee-45f4-b82d-23add3f16c40', 'tag': '7f5eeb8c-4f5d-4aff-8212-8c2f004ba255'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:23:35.332070 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d0138670-7990-461b-a1ea-39d0ac4c1436" -d '{"events": [{"name": "network-changed", "server_uuid": "8694df99-13ee-45f4-b82d-23add3f16c40", "tag": "7f5eeb8c-4f5d-4aff-8212-8c2f004ba255"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:23:35.346843 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Made reservation on behalf of 165504901a854a98988fc6ac8b063e92 for: {'network': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:23:35.349389 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.359185 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.458311 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-79b20098-7564-4f06-b7c6-b72e14ecc905 req-7e9566eb-7e0b-4f5b-b0a0-8f8a93656f89 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1227417 Nov 18 18:23:35.473269 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ec8cb53f-8ebb-4330-a788-84a46665f7ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:35.475324 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-ec8cb53f-8ebb-4330-a788-84a46665f7ea service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 1097 time: 0.0727243 Nov 18 18:23:35.498327 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.507724 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.543304 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cfe2b7db-ac3e-45d7-867b-7b8742065d79,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:35.549701 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1323} {{(pid=102688) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:23:35.549874 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-68aa90d4-a34b-434f-afcf-9fdc914196d6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 HTTP/1.1" status: 200 len: 217 time: 0.0535634 Nov 18 18:23:35.555082 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:23:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ecde258e-a99d-4927-b1df-7bb5528f095d x-openstack-request-id: req-ecde258e-a99d-4927-b1df-7bb5528f095d {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:23:35.555380 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8694df99-13ee-45f4-b82d-23add3f16c40", "tag": "7f5eeb8c-4f5d-4aff-8212-8c2f004ba255", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:23:35.556138 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-ecde258e-a99d-4927-b1df-7bb5528f095d {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:23:35.556418 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8694df99-13ee-45f4-b82d-23add3f16c40', 'tag': '7f5eeb8c-4f5d-4aff-8212-8c2f004ba255', 'status': 'completed', 'code': 200} Nov 18 18:23:35.562297 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.562707 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.segments_db [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Added segment 539f465f-adce-4bb3-b0bd-ed843ee5ddbd of type vlan for network 2790170f-8235-48ba-90b7-703cb0e757b6 Nov 18 18:23:35.610513 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.642223 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.643814 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:35.644576 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.646382 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38d3defc-3c94-4142-9cc0-cbde1febf841 req-9987e483-de98-4ed4-996a-b104cc4ab4db tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:35.648167 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-38d3defc-3c94-4142-9cc0-cbde1febf841 req-9987e483-de98-4ed4-996a-b104cc4ab4db tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 944 time: 0.1149194 Nov 18 18:23:35.653370 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-03585d57-9ca3-4557-9997-df01fa72bddf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:35.654555 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-03585d57-9ca3-4557-9997-df01fa72bddf service neutron] 10.222.0.31 "GET /v2.0/subnets?id=488ef4e4-e6f9-414a-b93f-aabd7b232f9e HTTP/1.1" status: 200 len: 855 time: 0.0741699 Nov 18 18:23:35.665602 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Sync routers for ids ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:23:35.676089 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Routers {'e8464c87-c9dc-43f0-9906-eda0c4a24cdb'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:35.676993 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:35.684872 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3700550 Nov 18 18:23:35.685631 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39432) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:35.698306 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-75afc834-ef36-4315-8f98-bb76aebc9f51 admin admin] Request body: {'subnet': {'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-746634804-subnet', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'ip_version': 4}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:35.703568 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-1c5e4571-2244-4a67-a32c-21f5fcfbb823 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0314488 Nov 18 18:23:35.737788 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d1672dc-5bb2-4683-b2ba-265e48916270 admin admin] Pushing event updated for resources: {'Network': ['ID=2790170f-8235-48ba-90b7-703cb0e757b6,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:35.751244 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-38d3defc-3c94-4142-9cc0-cbde1febf841 req-4a74b5ae-1f11-4b38-9f92-16170179ef31 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0956225 Nov 18 18:23:35.754690 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network 2790170f-8235-48ba-90b7-703cb0e757b6 details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:23:35.777984 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75afc834-ef36-4315-8f98-bb76aebc9f51 admin admin] Made reservation on behalf of 165504901a854a98988fc6ac8b063e92 for: {'subnet': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:23:35.779551 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-75afc834-ef36-4315-8f98-bb76aebc9f51 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.835682 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-364b8243-33ec-48b4-9f6c-f1fd6d70026f service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1193197 Nov 18 18:23:35.859536 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Set router e8464c87-c9dc-43f0-9906-eda0c4a24cdb gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:35.976575 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-75afc834-ef36-4315-8f98-bb76aebc9f51 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:35.999132 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7600baae-4137-4e40-ac0a-c4c8ee975c26 req-b549d682-d142-42c1-9025-bdbfb484043c service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1530845 Nov 18 18:23:36.010013 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aec249d-b1b1-4c2a-9449-0792ec122c15 req-1ff4852e-05b1-478d-aca1-393e32a355e9 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:36.011593 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5aec249d-b1b1-4c2a-9449-0792ec122c15 req-1ff4852e-05b1-478d-aca1-393e32a355e9 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 945 time: 0.0756919 Nov 18 18:23:36.052485 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75afc834-ef36-4315-8f98-bb76aebc9f51 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4e48127f-a501-4b91-b5fa-da7f1c7a9a7c,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:36.061931 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75afc834-ef36-4315-8f98-bb76aebc9f51 admin admin] Checking segment: {'id': '539f465f-adce-4bb3-b0bd-ed843ee5ddbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1323, 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:36.062342 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75afc834-ef36-4315-8f98-bb76aebc9f51 admin admin] Network hostable DHCP agents. Network: 2790170f-8235-48ba-90b7-703cb0e757b6, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102688) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:23:36.090785 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75afc834-ef36-4315-8f98-bb76aebc9f51 admin admin] Network 2790170f-8235-48ba-90b7-703cb0e757b6 is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102688) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:23:36.104329 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5aec249d-b1b1-4c2a-9449-0792ec122c15 req-f2a1c52a-09a1-4969-af46-89fc7bb0263b tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782204 Nov 18 18:23:36.110048 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-75afc834-ef36-4315-8f98-bb76aebc9f51 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, 2790170f-8235-48ba-90b7-703cb0e757b6) {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:36.133737 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ada6e3a3-8d9f-4a98-aa47-9f8f9e9097c3 None None] Network 2790170f-8235-48ba-90b7-703cb0e757b6 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:23:36.135062 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0138670-7990-461b-a1ea-39d0ac4c1436 req-e222cc6e-7c79-4c1d-b15f-93ad5cfff2a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:36.136625 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d0138670-7990-461b-a1ea-39d0ac4c1436 req-e222cc6e-7c79-4c1d-b15f-93ad5cfff2a2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 1097 time: 0.0479865 Nov 18 18:23:36.141053 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75afc834-ef36-4315-8f98-bb76aebc9f51 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:36.141883 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-75afc834-ef36-4315-8f98-bb76aebc9f51 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:36.163846 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-75afc834-ef36-4315-8f98-bb76aebc9f51 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.4705849 Nov 18 18:23:36.166224 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39440) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:36.171572 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-746634804-router', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:36.182706 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:33Z', 'revision_number': 4, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '6401bf2f-1763-4e1c-9200-1fa1bff41750', 'name': '', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'mac_address': 'fa:16:3e:e5:54:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_interface', 'standard_attr_id': 354, 'fixed_ips': [{'subnet_id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:31Z', 'updated_at': '2021-11-18T18:23:33Z', 'revision_number': 2, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'subnets': [{'id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:36.220698 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Checking router: e8464c87-c9dc-43f0-9906-eda0c4a24cdb for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:23:36.221290 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Updating router e8464c87-c9dc-43f0-9906-eda0c4a24cdb port 6401bf2f-1763-4e1c-9200-1fa1bff41750 binding host dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:23:36.233753 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-430558', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-543'] for router, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:36.237652 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-430410', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-500004', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1631324', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-534'] for router, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:36.261895 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0138670-7990-461b-a1ea-39d0ac4c1436 req-22ea5c39-2434-4855-a179-389ef7e9e3ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:36.263652 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d0138670-7990-461b-a1ea-39d0ac4c1436 req-22ea5c39-2434-4855-a179-389ef7e9e3ac service neutron] 10.222.0.31 "GET /v2.0/networks?id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 200 len: 917 time: 0.1132746 Nov 18 18:23:36.309482 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 79ca7317-593f-4234-aa06-60a8ba1fdb61 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:36.323881 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d0138670-7990-461b-a1ea-39d0ac4c1436 req-9dd02c64-d074-450c-8a35-0aefdd6cc238 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 HTTP/1.1" status: 200 len: 217 time: 0.0503283 Nov 18 18:23:36.324767 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:36.347134 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:36.376475 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0138670-7990-461b-a1ea-39d0ac4c1436 req-789f2697-7c05-477c-9193-0cc7cbbd6cb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:36.378194 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d0138670-7990-461b-a1ea-39d0ac4c1436 req-789f2697-7c05-477c-9193-0cc7cbbd6cb0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=488ef4e4-e6f9-414a-b93f-aabd7b232f9e HTTP/1.1" status: 200 len: 855 time: 0.0448890 Nov 18 18:23:36.437800 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d0138670-7990-461b-a1ea-39d0ac4c1436 req-3577d564-391d-47d4-aef5-65b7e6ca41db service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=14ac84aa-8c04-4323-8592-aecfbb5a7fe1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0406833 Nov 18 18:23:36.512518 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:36.584439 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-8e18a6a0-51d8-4cbb-8373-90bac781fe63 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:36.658713 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 79ca7317-593f-4234-aa06-60a8ba1fdb61 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:36.659111 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:36.668315 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d0138670-7990-461b-a1ea-39d0ac4c1436 req-f387fb2e-5db8-466e-af7f-b6f1e91833b6 service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2115703 Nov 18 18:23:36.680380 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eb8756e-9772-4afa-b387-887d7175c5eb req-0dc89207-b290-4635-b1e6-e78e68f41017 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:36.683063 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1eb8756e-9772-4afa-b387-887d7175c5eb req-0dc89207-b290-4635-b1e6-e78e68f41017 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0776896 Nov 18 18:23:36.729204 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc1c763e3-2102-51f8-97fe-c751e57774c1-2790170f-8235-48ba-90b7-703cb0e757b6', 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'fixed_ips': [{'subnet_id': '4e48127f-a501-4b91-b5fa-da7f1c7a9a7c'}]}} from dv-cinder-787764-6-iscsi. {{(pid=102690) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 18:23:36.730064 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:36.810983 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1eb8756e-9772-4afa-b387-887d7175c5eb req-f3e32f8a-83f2-4a58-b448-b5e87a862025 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1198161 Nov 18 18:23:36.841622 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d0138670-7990-461b-a1ea-39d0ac4c1436 req-a73b8832-d912-487b-96e0-7e1732f73a7a service neutron] 10.222.0.31 "GET /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1574969 Nov 18 18:23:36.945080 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-803430b0-4296-44c9-b15b-3e9ddab6f346 req-803bb53e-732b-4591-912d-fa1a942bb66e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:36.954950 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-803430b0-4296-44c9-b15b-3e9ddab6f346 req-803bb53e-732b-4591-912d-fa1a942bb66e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 944 time: 0.0932152 Nov 18 18:23:37.023885 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.db_base_plugin_common [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Allocated IP 172.20.0.2 (2790170f-8235-48ba-90b7-703cb0e757b6/4e48127f-a501-4b91-b5fa-da7f1c7a9a7c/23bd19ff-4e26-46ff-bf20-146c16b30884) {{(pid=102690) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:37.043793 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Publish callbacks [] for port, precommit_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.048628 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-803430b0-4296-44c9-b15b-3e9ddab6f346 req-6aa55106-9ba1-418a-8291-ee6996f84abf tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0927236 Nov 18 18:23:37.064271 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.084484 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.129662 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.169212 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7921c0b6-189c-420f-a3e3-c396e0032987 None None] Pushing event updated for resources: {'Port': ['ID=6401bf2f-1763-4e1c-9200-1fa1bff41750,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:37.252025 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d80803c-2f74-4a01-bf89-5840efd44af3 req-41d2bdbf-7622-49ef-bf4c-6bff490791d9 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:37.256180 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0d80803c-2f74-4a01-bf89-5840efd44af3 req-41d2bdbf-7622-49ef-bf4c-6bff490791d9 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 945 time: 0.0534680 Nov 18 18:23:37.296293 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Attempting to bind port 6401bf2f-1763-4e1c-9200-1fa1bff41750 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:37.296723 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Attempting to bind port 6401bf2f-1763-4e1c-9200-1fa1bff41750 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:37.297252 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Attempting to bind port 6401bf2f-1763-4e1c-9200-1fa1bff41750 on network c5332eb5-c186-4bcf-89d9-eb78be973548 {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:37.317968 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0d80803c-2f74-4a01-bf89-5840efd44af3 req-eaed7762-4c03-431e-ada4-72a06cd05cf3 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0567853 Nov 18 18:23:37.320826 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:37.321344 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Checking segment: {'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:37.321959 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.322417 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Bound using segment: {'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:37.323002 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Bound port: 6401bf2f-1763-4e1c-9200-1fa1bff41750, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:37.323631 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.339796 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Allocated IP 172.27.1.220 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/a5d9899d-154d-4e99-9bd1-5124d0b912d0) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:37.385813 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Publish callbacks [] for port, precommit_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.401337 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.455474 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Network 2790170f-8235-48ba-90b7-703cb0e757b6 is already hosted by enough agents. {{(pid=102690) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:37.456578 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] For port 6401bf2f-1763-4e1c-9200-1fa1bff41750, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:37.461754 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.base_scheduler [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Resources bound (agent type, host, resource id): {{(pid=102690) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:37.471128 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Received port after_create {{(pid=102690) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:37.472086 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.513181 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.556881 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:37.560116 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:37.566983 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:37.570618 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Pushing event updated for resources: {'Port': ['ID=a5d9899d-154d-4e99-9bd1-5124d0b912d0,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:37.605879 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] For port 6401bf2f-1763-4e1c-9200-1fa1bff41750, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=6401bf2f-1763-4e1c-9200-1fa1bff41750,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:37.608379 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Pushing event updated for resources: {'Port': ['ID=23bd19ff-4e26-46ff-bf20-146c16b30884,revision_number=1']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:37.634339 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.681861 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-a4bc43d7-21de-4123-916b-dd0983ed9dd7 None None] Provisioning complete for port 6401bf2f-1763-4e1c-9200-1fa1bff41750 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:37.682237 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a4bc43d7-21de-4123-916b-dd0983ed9dd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.741514 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Attempting to bind port 23bd19ff-4e26-46ff-bf20-146c16b30884 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:37.741878 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Attempting to bind port 23bd19ff-4e26-46ff-bf20-146c16b30884 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '539f465f-adce-4bb3-b0bd-ed843ee5ddbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1323, 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:37.742240 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Attempting to bind port 23bd19ff-4e26-46ff-bf20-146c16b30884 on network 2790170f-8235-48ba-90b7-703cb0e757b6 {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:37.768453 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.773134 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:37.773511 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Checking segment: {'id': '539f465f-adce-4bb3-b0bd-ed843ee5ddbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1323, 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:37.773910 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.774304 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Bound using segment: {'id': '539f465f-adce-4bb3-b0bd-ed843ee5ddbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1323, 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:37.774778 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Bound port: 23bd19ff-4e26-46ff-bf20-146c16b30884, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '539f465f-adce-4bb3-b0bd-ed843ee5ddbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1323, 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:37.775155 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.783279 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7921c0b6-189c-420f-a3e3-c396e0032987 None None] Pushing event updated for resources: {'Port': ['ID=6401bf2f-1763-4e1c-9200-1fa1bff41750,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:37.801008 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Routers {'e8464c87-c9dc-43f0-9906-eda0c4a24cdb'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:37.801709 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:37.830930 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.954873 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b526bdd2-cc0e-482b-b37b-5cfff6b1580e req-a3bd208f-6a37-41be-ae4c-94bca5087f2b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:37.957309 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b526bdd2-cc0e-482b-b37b-5cfff6b1580e req-a3bd208f-6a37-41be-ae4c-94bca5087f2b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0693896 Nov 18 18:23:37.960153 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] For port 23bd19ff-4e26-46ff-bf20-146c16b30884, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:37.975982 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a4bc43d7-21de-4123-916b-dd0983ed9dd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:37.982215 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] For port 23bd19ff-4e26-46ff-bf20-146c16b30884, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=23bd19ff-4e26-46ff-bf20-146c16b30884,segment=NetworkSegment(539f465f-adce-4bb3-b0bd-ed843ee5ddbd),segment_id=539f465f-adce-4bb3-b0bd-ed843ee5ddbd)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:37.998876 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:38.022127 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b526bdd2-cc0e-482b-b37b-5cfff6b1580e req-4d52670d-9e0f-45b4-9567-f36154e81434 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554869 Nov 18 18:23:38.040876 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] Set router e8464c87-c9dc-43f0-9906-eda0c4a24cdb gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:38.067481 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-430421', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-500439'] for router, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:38.109393 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-a4bc43d7-21de-4123-916b-dd0983ed9dd7 None None] For port 6401bf2f-1763-4e1c-9200-1fa1bff41750, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=6401bf2f-1763-4e1c-9200-1fa1bff41750,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:38.159294 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a4bc43d7-21de-4123-916b-dd0983ed9dd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:38.175738 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cb9daa9-ac5c-404a-b14c-ba668559bf42 None None] Pushing event updated for resources: {'Port': ['ID=23bd19ff-4e26-46ff-bf20-146c16b30884,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:38.251125 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acbb7eef-f6eb-462a-8bad-07b28b8ca4bb req-b8b4f6b6-68ea-4d94-8c32-c6963f74dbaf tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:38.253407 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-acbb7eef-f6eb-462a-8bad-07b28b8ca4bb req-b8b4f6b6-68ea-4d94-8c32-c6963f74dbaf tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 944 time: 0.0813746 Nov 18 18:23:38.259965 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Router 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc is scheduled to L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 with binding_index 1 {{(pid=102688) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 18:23:38.300451 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4bc43d7-21de-4123-916b-dd0983ed9dd7 None None] Pushing event updated for resources: {'Port': ['ID=6401bf2f-1763-4e1c-9200-1fa1bff41750,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:38.329156 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-b6b924a3-ccf2-45eb-8cd4-390cca7a0851 None None] Provisioning complete for port 6401bf2f-1763-4e1c-9200-1fa1bff41750 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:38.329156 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-b6b924a3-ccf2-45eb-8cd4-390cca7a0851 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:38.342246 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-acbb7eef-f6eb-462a-8bad-07b28b8ca4bb req-2e9e3552-8c73-4c1d-a484-f486fe97d6f5 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798228 Nov 18 18:23:38.459261 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:23:38.483173 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Sync routers for ids ['2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:23:38.495259 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Routers {'2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:38.496263 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:38.508750 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] Publish callbacks [] for router, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:38.510014 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-28b952d6-54ea-4ece-acc2-a07cae942aa6 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.3425932 Nov 18 18:23:38.514283 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 39494) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:23:38.514541 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6956089-d71a-4ab9-b26d-e94e6dce3860 req-139ad13e-a6a4-49f3-94cf-c1a8bd90b92f tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:38.516264 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e6956089-d71a-4ab9-b26d-e94e6dce3860 req-139ad13e-a6a4-49f3-94cf-c1a8bd90b92f tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 945 time: 0.0947673 Nov 18 18:23:38.543428 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:33Z', 'revision_number': 4, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '6401bf2f-1763-4e1c-9200-1fa1bff41750', 'name': '', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'mac_address': 'fa:16:3e:e5:54:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_interface', 'standard_attr_id': 354, 'fixed_ips': [{'subnet_id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:31Z', 'updated_at': '2021-11-18T18:23:37Z', 'revision_number': 4, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'subnets': [{'id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:38.596789 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e6956089-d71a-4ab9-b26d-e94e6dce3860 req-cef51baf-4ab3-4d4c-beaf-7d35b240ae3d tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704772 Nov 18 18:23:38.609038 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1279f236-b612-482b-93e7-0b1bfe4f5f51 None None] The sync data for ids ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'] in dv-cinder-787764-6-iscsi is: [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:33Z', 'revision_number': 4, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '6401bf2f-1763-4e1c-9200-1fa1bff41750', 'name': '', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'mac_address': 'fa:16:3e:e5:54:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_interface', 'standard_attr_id': 354, 'fixed_ips': [{'subnet_id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:31Z', 'updated_at': '2021-11-18T18:23:37Z', 'revision_number': 4, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'subnets': [{'id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:23:38.619092 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Set router 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:38.910027 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'name': 'tempest-TestMinimumBasicScenario-746634804-router', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220'}], 'enable_snat': True}, 'gw_port_id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:36Z', 'updated_at': '2021-11-18T18:23:37Z', 'revision_number': 3, 'project_id': '165504901a854a98988fc6ac8b063e92', 'gw_port': {'id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:bd:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:37Z', 'updated_at': '2021-11-18T18:23:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:38.951784 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Checking router: 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:23:38.952257 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Updating router 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc port a5d9899d-154d-4e99-9bd1-5124d0b912d0 binding host dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:23:38.979084 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.050499 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.162617 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:23:39.260306 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.263322 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22fcaa9e-6948-4d58-b6bd-9b3b697d65dc req-1f9f855b-fda7-4406-b186-9f56bc87d2cc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:39.265678 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22fcaa9e-6948-4d58-b6bd-9b3b697d65dc req-1f9f855b-fda7-4406-b186-9f56bc87d2cc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1114841 Nov 18 18:23:39.353465 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:39.369097 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '7f5eeb8c-4f5d-4aff-8212-8c2f004ba255', 'network_id': '14ac84aa-8c04-4323-8592-aecfbb5a7fe1', 'port_id': '7f5eeb8c-4f5d-4aff-8212-8c2f004ba255', 'mac_address': 'fa:16:3e:33:71:eb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1303, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '488ef4e4-e6f9-414a-b93f-aabd7b232f9e', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:23:39.413417 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22fcaa9e-6948-4d58-b6bd-9b3b697d65dc req-9712ad92-aea3-41ee-a6d8-1dc9b6f1a748 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1365554 Nov 18 18:23:39.427380 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.474633 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:23:39.516922 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:39.532712 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.568807 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Allocated IP 172.20.0.1 (2790170f-8235-48ba-90b7-703cb0e757b6/4e48127f-a501-4b91-b5fa-da7f1c7a9a7c/afc98e3b-9711-4de0-a528-319542997a98) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:39.605929 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7657f5b-76c5-4801-97f7-c51569d098de req-30f701e9-2663-40df-8c42-588154df3b35 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:39.607509 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c7657f5b-76c5-4801-97f7-c51569d098de req-30f701e9-2663-40df-8c42-588154df3b35 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.31 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 945 time: 0.1913590 Nov 18 18:23:39.626314 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Publish callbacks [] for port, precommit_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.631194 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:39.636791 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.688721 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead496c5-e1cd-4500-8993-a2d0c7102613 req-c9d20d3a-4636-4dac-bc0f-454e4e75c4f1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:39.697275 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ead496c5-e1cd-4500-8993-a2d0c7102613 req-c9d20d3a-4636-4dac-bc0f-454e4e75c4f1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 944 time: 0.2050614 Nov 18 18:23:39.701999 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ca70307-beec-4fd6-9458-3845574fbae8 None None] Pushing event updated for resources: {'Port': ['ID=a5d9899d-154d-4e99-9bd1-5124d0b912d0,revision_number=2']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:39.704851 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78bc51f0-418b-49a3-a4e9-a113f8a6a39b None None] Network 2790170f-8235-48ba-90b7-703cb0e757b6 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:23:39.738482 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Attempting to bind port a5d9899d-154d-4e99-9bd1-5124d0b912d0 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:39.738851 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Attempting to bind port a5d9899d-154d-4e99-9bd1-5124d0b912d0 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:39.739207 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Attempting to bind port a5d9899d-154d-4e99-9bd1-5124d0b912d0 on network 2cab888d-52a8-434c-814e-4f25740decd0 {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:39.759163 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:39.759547 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Checking segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102691) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:39.759977 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.760378 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Bound using segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:39.760859 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Bound port: a5d9899d-154d-4e99-9bd1-5124d0b912d0, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:39.761255 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.831920 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.839806 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] For port a5d9899d-154d-4e99-9bd1-5124d0b912d0, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102691) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:39.843633 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] For port a5d9899d-154d-4e99-9bd1-5124d0b912d0, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=a5d9899d-154d-4e99-9bd1-5124d0b912d0,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102691) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:39.851415 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.890273 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.920217 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-f5487eaf-a37d-437d-9450-ff4f6bfa47f7 None None] Provisioning complete for port 23bd19ff-4e26-46ff-bf20-146c16b30884 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:39.920744 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f5487eaf-a37d-437d-9450-ff4f6bfa47f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:39.936780 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ca70307-beec-4fd6-9458-3845574fbae8 None None] Pushing event updated for resources: {'Port': ['ID=a5d9899d-154d-4e99-9bd1-5124d0b912d0,revision_number=3']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:39.945439 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Routers {'2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:39.946058 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:39.964559 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3abe4680-1df8-40b0-906a-cd2ed1de94f8 req-6c1f2537-603b-4b87-9b97-922a654583db tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:39.978634 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3abe4680-1df8-40b0-906a-cd2ed1de94f8 req-6c1f2537-603b-4b87-9b97-922a654583db tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 945 time: 0.2097132 Nov 18 18:23:39.983398 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Network 2790170f-8235-48ba-90b7-703cb0e757b6 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:39.997046 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ead496c5-e1cd-4500-8993-a2d0c7102613 req-13de8b42-e4c1-4ecf-946d-8c0252c28d1f tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2989872 Nov 18 18:23:40.001994 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:40.007469 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:40.007970 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-500260'] for router_interface, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:40.050727 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['7f5eeb8c-4f5d-4aff-8212-8c2f004ba255'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:23:40.086625 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-c7657f5b-76c5-4801-97f7-c51569d098de req-7d45dda4-8d3f-4485-a495-62524e19b534 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Deleting port d070011f-e438-4b08-b097-5cac8c261ba4 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:23:40.086842 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-c7657f5b-76c5-4801-97f7-c51569d098de req-7d45dda4-8d3f-4485-a495-62524e19b534 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:40.088538 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] Set router 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:40.116214 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f5487eaf-a37d-437d-9450-ff4f6bfa47f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:40.131855 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3abe4680-1df8-40b0-906a-cd2ed1de94f8 req-ebfefa0d-ff4e-4d3f-a7fb-1f943ec0b848 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/security-groups?id=ff5c1222-8b6f-43f9-a79e-85bbc10341c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1502051 Nov 18 18:23:40.178910 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Pushing event updated for resources: {'Port': ['ID=afc98e3b-9711-4de0-a528-319542997a98,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:40.267674 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-f5487eaf-a37d-437d-9450-ff4f6bfa47f7 None None] For port 23bd19ff-4e26-46ff-bf20-146c16b30884, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=23bd19ff-4e26-46ff-bf20-146c16b30884,segment=NetworkSegment(539f465f-adce-4bb3-b0bd-ed843ee5ddbd),segment_id=539f465f-adce-4bb3-b0bd-ed843ee5ddbd)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:40.313642 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:40.319717 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f5487eaf-a37d-437d-9450-ff4f6bfa47f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:40.359208 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:40.618283 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5487eaf-a37d-437d-9450-ff4f6bfa47f7 None None] Pushing event updated for resources: {'Port': ['ID=23bd19ff-4e26-46ff-bf20-146c16b30884,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:40.621052 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 6401bf2f-1763-4e1c-9200-1fa1bff41750 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:40.689343 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'name': 'tempest-TestMinimumBasicScenario-746634804-router', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220'}], 'enable_snat': True}, 'gw_port_id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:36Z', 'updated_at': '2021-11-18T18:23:37Z', 'revision_number': 3, 'project_id': '165504901a854a98988fc6ac8b063e92', 'gw_port': {'id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:bd:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:37Z', 'updated_at': '2021-11-18T18:23:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:40.696300 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a76cca34-b509-4927-88ed-5444a683dd91 req-8f5a67a0-3819-4e50-9a71-00dbbd87d0bb tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:40.700085 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a76cca34-b509-4927-88ed-5444a683dd91 req-8f5a67a0-3819-4e50-9a71-00dbbd87d0bb tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1345673 Nov 18 18:23:40.733177 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 6401bf2f-1763-4e1c-9200-1fa1bff41750 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:40.733561 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:40.743114 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-c7657f5b-76c5-4801-97f7-c51569d098de req-7d45dda4-8d3f-4485-a495-62524e19b534 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] For port d070011f-e438-4b08-b097-5cac8c261ba4, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=d070011f-e438-4b08-b097-5cac8c261ba4,segment=NetworkSegment(d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20),segment_id=d50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:40.743480 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-c7657f5b-76c5-4801-97f7-c51569d098de req-7d45dda4-8d3f-4485-a495-62524e19b534 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:40.776275 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-257df70f-5d16-41a7-8286-338a406ab2b5 None None] The sync data for ids ['2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'] in dv-cinder-787764-6-iscsi is: [{'id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'name': 'tempest-TestMinimumBasicScenario-746634804-router', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220'}], 'enable_snat': True}, 'gw_port_id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:36Z', 'updated_at': '2021-11-18T18:23:37Z', 'revision_number': 3, 'project_id': '165504901a854a98988fc6ac8b063e92', 'gw_port': {'id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:bd:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:37Z', 'updated_at': '2021-11-18T18:23:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:23:40.786665 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-c7657f5b-76c5-4801-97f7-c51569d098de req-7d45dda4-8d3f-4485-a495-62524e19b534 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Calling delete_port for d070011f-e438-4b08-b097-5cac8c261ba4 owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:23:40.792643 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a76cca34-b509-4927-88ed-5444a683dd91 req-68cd8929-f51e-48a2-b3d9-b2a5c54304cc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0750375 Nov 18 18:23:40.875868 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:40.877507 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 23bd19ff-4e26-46ff-bf20-146c16b30884 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:40.885531 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:40.886603 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1772530', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-499092'] for router_interface, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:41.027571 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-c7657f5b-76c5-4801-97f7-c51569d098de req-7d45dda4-8d3f-4485-a495-62524e19b534 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:41.119215 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Pushing event updated for resources: {'Port': ['ID=afc98e3b-9711-4de0-a528-319542997a98,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:41.150226 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d45dda4-8d3f-4485-a495-62524e19b534 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Pushing event deleted for resources: {'Port': ['ID=d070011f-e438-4b08-b097-5cac8c261ba4,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:41.174946 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Network 2790170f-8235-48ba-90b7-703cb0e757b6 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:41.183955 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:41.203310 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-c7657f5b-76c5-4801-97f7-c51569d098de req-7d45dda4-8d3f-4485-a495-62524e19b534 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] No DVR routers for this DVR port d070011f-e438-4b08-b097-5cac8c261ba4 on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:23:41.211261 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-c7657f5b-76c5-4801-97f7-c51569d098de req-7d45dda4-8d3f-4485-a495-62524e19b534 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:41.216687 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c7657f5b-76c5-4801-97f7-c51569d098de req-7d45dda4-8d3f-4485-a495-62524e19b534 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.31 "DELETE /v2.0/ports/d070011f-e438-4b08-b097-5cac8c261ba4 HTTP/1.1" status: 204 len: 173 time: 1.5976574 Nov 18 18:23:41.217494 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '619976bf-fa6c-40cd-a53b-d98f17befea6', 'name': 'network-vif-deleted', 'tag': 'd070011f-e438-4b08-b097-5cac8c261ba4'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:23:41.220477 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4631c501-6d7b-4190-8369-e15356db0745" -d '{"events": [{"server_uuid": "619976bf-fa6c-40cd-a53b-d98f17befea6", "name": "network-vif-deleted", "tag": "d070011f-e438-4b08-b097-5cac8c261ba4"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:23:41.232362 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-f9371d45-ca1b-4d5f-a396-64e4ae669d8b None None] Provisioning complete for port afc98e3b-9711-4de0-a528-319542997a98 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:41.233238 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f9371d45-ca1b-4d5f-a396-64e4ae669d8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:41.269587 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2060c8ba-b5df-4335-811c-7f4c7c40d11c req-5b54fd32-8335-4353-a3a9-626a59709f45 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:41.273112 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2060c8ba-b5df-4335-811c-7f4c7c40d11c req-5b54fd32-8335-4353-a3a9-626a59709f45 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 945 time: 0.1318924 Nov 18 18:23:41.276216 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 23bd19ff-4e26-46ff-bf20-146c16b30884 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:41.276591 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:41.307039 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-f9371d45-ca1b-4d5f-a396-64e4ae669d8b None None] Port afc98e3b-9711-4de0-a528-319542997a98 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:23:41.345017 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-f9371d45-ca1b-4d5f-a396-64e4ae669d8b None None] Provisioning complete for port 23bd19ff-4e26-46ff-bf20-146c16b30884 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:41.345400 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f9371d45-ca1b-4d5f-a396-64e4ae669d8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:41.351312 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Router 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102688) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:23:41.401298 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2060c8ba-b5df-4335-811c-7f4c7c40d11c req-3955a72e-47c9-4bf2-9f87-bef7d86b7f73 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1200109 Nov 18 18:23:41.424007 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-67debee9-eeea-492b-a20d-99d215bd9fa4 req-b0e54b96-a660-4148-a452-a81e9cd2b895 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 210 time: 0.0826309 Nov 18 18:23:41.465623 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:23:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4e43151-f6ee-460f-a81e-565bef0c52e3 x-openstack-request-id: req-e4e43151-f6ee-460f-a81e-565bef0c52e3 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:23:41.466108 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "619976bf-fa6c-40cd-a53b-d98f17befea6", "name": "network-vif-deleted", "tag": "d070011f-e438-4b08-b097-5cac8c261ba4", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:23:41.466516 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-e4e43151-f6ee-460f-a81e-565bef0c52e3 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:23:41.467083 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '619976bf-fa6c-40cd-a53b-d98f17befea6', 'name': 'network-vif-deleted', 'tag': 'd070011f-e438-4b08-b097-5cac8c261ba4', 'status': 'completed', 'code': 200} Nov 18 18:23:41.652426 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-f64b0f47-0be0-483a-83c5-a8eaec34a207 None None] Provisioning complete for port afc98e3b-9711-4de0-a528-319542997a98 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:41.652953 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f64b0f47-0be0-483a-83c5-a8eaec34a207 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:41.701878 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-f64b0f47-0be0-483a-83c5-a8eaec34a207 None None] Port afc98e3b-9711-4de0-a528-319542997a98 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:23:41.741484 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:23:41.746615 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-ea2d1161-dcb7-430f-9990-7f81e669d830 admin admin] 10.222.0.82 "PUT /v2.0/routers/2de1c8b7-3943-484e-a8c5-7c4d3d416fdc/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2303503 Nov 18 18:23:41.941249 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484802fa-b3f2-431b-86d3-cb1c39539bc7 req-4d08d8ae-7228-42c6-b3e5-c91aaf5a8df5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:41.942878 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-484802fa-b3f2-431b-86d3-cb1c39539bc7 req-4d08d8ae-7228-42c6-b3e5-c91aaf5a8df5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0539405 Nov 18 18:23:42.010989 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-484802fa-b3f2-431b-86d3-cb1c39539bc7 req-b1d931a6-ee35-4a5d-a752-1ed7e40f4d37 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0585985 Nov 18 18:23:42.349214 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 23bd19ff-4e26-46ff-bf20-146c16b30884 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:42.399645 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 23bd19ff-4e26-46ff-bf20-146c16b30884 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:42.400041 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:42.505107 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device a5d9899d-154d-4e99-9bd1-5124d0b912d0 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:42.556618 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port a5d9899d-154d-4e99-9bd1-5124d0b912d0 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:42.557119 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:42.558270 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ee767550-bdba-4749-bba7-affdbf8b5629 req-3224a61d-dfb1-46e6-a2ed-10f1556aeb99 tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 210 time: 0.0356822 Nov 18 18:23:42.603340 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec55886e-206c-4267-9180-7c07cd3828c5 req-8eb42f42-33b2-446c-a4da-7bab62fa49bb tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:42.611075 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ec55886e-206c-4267-9180-7c07cd3828c5 req-8eb42f42-33b2-446c-a4da-7bab62fa49bb tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 945 time: 0.1166093 Nov 18 18:23:42.673044 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:42.685238 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ec55886e-206c-4267-9180-7c07cd3828c5 req-b1480a4d-938c-4df1-b828-0ecab47ddc8f tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731881 Nov 18 18:23:42.717386 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port a5d9899d-154d-4e99-9bd1-5124d0b912d0, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=a5d9899d-154d-4e99-9bd1-5124d0b912d0,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:42.723968 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:42.786043 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=a5d9899d-154d-4e99-9bd1-5124d0b912d0,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:43.174900 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Sync routers for ids ['2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:23:43.179606 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6277daa5-359d-49a4-ba73-a88194d0b7f5 req-e2ed6538-de02-4561-a42b-080c27008ac1 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:43.181207 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6277daa5-359d-49a4-ba73-a88194d0b7f5 req-e2ed6538-de02-4561-a42b-080c27008ac1 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0604279 Nov 18 18:23:43.186708 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Routers {'2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:43.187263 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:43.261529 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6277daa5-359d-49a4-ba73-a88194d0b7f5 req-153a8cfb-a0c6-46ec-856f-baed9a0d9ba9 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0670164 Nov 18 18:23:43.318448 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Set router 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:43.587528 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'name': 'tempest-TestMinimumBasicScenario-746634804-router', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220'}], 'enable_snat': True}, 'gw_port_id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:36Z', 'updated_at': '2021-11-18T18:23:40Z', 'revision_number': 4, 'project_id': '165504901a854a98988fc6ac8b063e92', 'gw_port': {'id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:bd:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:37Z', 'updated_at': '2021-11-18T18:23:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'afc98e3b-9711-4de0-a528-319542997a98', 'name': '', 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'mac_address': 'fa:16:3e:a6:76:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 366, 'fixed_ips': [{'subnet_id': '4e48127f-a501-4b91-b5fa-da7f1c7a9a7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:39Z', 'updated_at': '2021-11-18T18:23:40Z', 'revision_number': 2, 'project_id': '165504901a854a98988fc6ac8b063e92', 'subnets': [{'id': '4e48127f-a501-4b91-b5fa-da7f1c7a9a7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:43.617209 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Checking router: 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:23:43.617616 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Updating router 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc port afc98e3b-9711-4de0-a528-319542997a98 binding host dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:23:43.645774 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:43.716238 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2f87c247-37a8-4e99-b634-c0e856962c56 req-c4fefb58-fa44-4a03-b00b-03cb21b5727c tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 210 time: 0.0382903 Nov 18 18:23:43.898945 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94378387-f7d9-4128-ba84-045ce13f96a0 req-84c85f8c-0d40-422e-8720-1913b6c26667 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:43.907240 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-94378387-f7d9-4128-ba84-045ce13f96a0 req-84c85f8c-0d40-422e-8720-1913b6c26667 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 945 time: 0.0863514 Nov 18 18:23:43.970511 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-94378387-f7d9-4128-ba84-045ce13f96a0 req-63f0fb98-9dc0-4067-aa8c-016948638b14 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533288 Nov 18 18:23:44.043805 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Publish callbacks [] for port, precommit_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:44.051815 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:44.102713 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5bad565-5d66-47dd-b412-ee685800729e None None] Pushing event updated for resources: {'Port': ['ID=afc98e3b-9711-4de0-a528-319542997a98,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:44.174762 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Attempting to bind port afc98e3b-9711-4de0-a528-319542997a98 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:44.175133 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Attempting to bind port afc98e3b-9711-4de0-a528-319542997a98 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '539f465f-adce-4bb3-b0bd-ed843ee5ddbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1323, 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:44.175553 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Attempting to bind port afc98e3b-9711-4de0-a528-319542997a98 on network 2790170f-8235-48ba-90b7-703cb0e757b6 {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:44.182318 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:44.182691 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Checking segment: {'id': '539f465f-adce-4bb3-b0bd-ed843ee5ddbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1323, 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:44.184667 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:44.185109 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Bound using segment: {'id': '539f465f-adce-4bb3-b0bd-ed843ee5ddbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1323, 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:44.185604 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Bound port: afc98e3b-9711-4de0-a528-319542997a98, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '539f465f-adce-4bb3-b0bd-ed843ee5ddbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1323, 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:44.185993 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:44.310333 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] For port afc98e3b-9711-4de0-a528-319542997a98, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:44.316410 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] For port afc98e3b-9711-4de0-a528-319542997a98, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=afc98e3b-9711-4de0-a528-319542997a98,segment=NetworkSegment(539f465f-adce-4bb3-b0bd-ed843ee5ddbd),segment_id=539f465f-adce-4bb3-b0bd-ed843ee5ddbd)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:44.327271 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device a5d9899d-154d-4e99-9bd1-5124d0b912d0 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:44.330869 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:44.417734 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd117a5-0a89-4251-967b-ab0b38332cc3 req-463b9ff3-47dc-4e5f-83f0-7080aa6893b6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:44.419296 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6dd117a5-0a89-4251-967b-ab0b38332cc3 req-463b9ff3-47dc-4e5f-83f0-7080aa6893b6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0726724 Nov 18 18:23:44.496236 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6dd117a5-0a89-4251-967b-ab0b38332cc3 req-224e3182-00a4-43a0-b468-407ddab09140 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0690136 Nov 18 18:23:44.497833 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Routers {'2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:23:44.498475 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:23:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:44.553958 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5bad565-5d66-47dd-b412-ee685800729e None None] Pushing event updated for resources: {'Port': ['ID=afc98e3b-9711-4de0-a528-319542997a98,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:44.579191 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-4755ff1d-8c01-4c00-a56a-8e8a1b684f07 None None] Provisioning complete for port afc98e3b-9711-4de0-a528-319542997a98 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:44.579571 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-4755ff1d-8c01-4c00-a56a-8e8a1b684f07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:44.586526 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port a5d9899d-154d-4e99-9bd1-5124d0b912d0 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:44.586893 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:44.667388 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device d070011f-e438-4b08-b097-5cac8c261ba4 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:23:44.705783 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: d070011f-e438-4b08-b097-5cac8c261ba4 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:23:44.706150 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device d070011f-e438-4b08-b097-5cac8c261ba4 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:23:44.829309 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] Set router 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:23:44.865219 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4f13e0c4-83a2-4da5-b949-f6cc180a3243 req-8acd953d-5c40-4dc4-b602-a49e2e32979d tempest-VolumesActionsTest-2079781858 tempest-VolumesActionsTest-2079781858-project] 10.222.0.82 "GET /v2.0/ports?device_id=619976bf-fa6c-40cd-a53b-d98f17befea6 HTTP/1.1" status: 200 len: 210 time: 0.0472944 Nov 18 18:23:45.124671 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3bf7788-e054-4bce-835a-90737fece1ba req-eb9b26bc-4f00-4731-9f99-6783e599e83e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:45.133290 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e3bf7788-e054-4bce-835a-90737fece1ba req-eb9b26bc-4f00-4731-9f99-6783e599e83e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 945 time: 0.0652530 Nov 18 18:23:45.180894 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:45.203882 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e3bf7788-e054-4bce-835a-90737fece1ba req-04fd6593-00ad-4ef2-a040-957a207f1374 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695634 Nov 18 18:23:45.238305 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-4755ff1d-8c01-4c00-a56a-8e8a1b684f07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:45.337167 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-4755ff1d-8c01-4c00-a56a-8e8a1b684f07 None None] For port afc98e3b-9711-4de0-a528-319542997a98, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=afc98e3b-9711-4de0-a528-319542997a98,segment=NetworkSegment(539f465f-adce-4bb3-b0bd-ed843ee5ddbd),segment_id=539f465f-adce-4bb3-b0bd-ed843ee5ddbd)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:45.349399 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-4755ff1d-8c01-4c00-a56a-8e8a1b684f07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:45.391419 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:23:45.402738 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:45.403131 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:45.477166 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4755ff1d-8c01-4c00-a56a-8e8a1b684f07 None None] Pushing event updated for resources: {'Port': ['ID=afc98e3b-9711-4de0-a528-319542997a98,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:45.507965 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'name': 'tempest-TestMinimumBasicScenario-746634804-router', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220'}], 'enable_snat': True}, 'gw_port_id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:36Z', 'updated_at': '2021-11-18T18:23:40Z', 'revision_number': 4, 'project_id': '165504901a854a98988fc6ac8b063e92', 'gw_port': {'id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:bd:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:37Z', 'updated_at': '2021-11-18T18:23:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'afc98e3b-9711-4de0-a528-319542997a98', 'name': '', 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'mac_address': 'fa:16:3e:a6:76:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 366, 'fixed_ips': [{'subnet_id': '4e48127f-a501-4b91-b5fa-da7f1c7a9a7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:39Z', 'updated_at': '2021-11-18T18:23:44Z', 'revision_number': 4, 'project_id': '165504901a854a98988fc6ac8b063e92', 'subnets': [{'id': '4e48127f-a501-4b91-b5fa-da7f1c7a9a7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:23:45.548511 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-af839335-9864-4dd3-930f-ff04de8186ba None None] Provisioning complete for port afc98e3b-9711-4de0-a528-319542997a98 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:45.548963 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-af839335-9864-4dd3-930f-ff04de8186ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:45.554723 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dbfcdbb-4d28-4207-9769-f6221bcb433b None None] The sync data for ids ['2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'] in dv-cinder-787764-6-iscsi is: [{'id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'name': 'tempest-TestMinimumBasicScenario-746634804-router', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220'}], 'enable_snat': True}, 'gw_port_id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:36Z', 'updated_at': '2021-11-18T18:23:40Z', 'revision_number': 4, 'project_id': '165504901a854a98988fc6ac8b063e92', 'gw_port': {'id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:bd:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:37Z', 'updated_at': '2021-11-18T18:23:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'afc98e3b-9711-4de0-a528-319542997a98', 'name': '', 'network_id': '2790170f-8235-48ba-90b7-703cb0e757b6', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'mac_address': 'fa:16:3e:a6:76:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'device_owner': 'network:router_interface', 'standard_attr_id': 366, 'fixed_ips': [{'subnet_id': '4e48127f-a501-4b91-b5fa-da7f1c7a9a7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:39Z', 'updated_at': '2021-11-18T18:23:44Z', 'revision_number': 4, 'project_id': '165504901a854a98988fc6ac8b063e92', 'subnets': [{'id': '4e48127f-a501-4b91-b5fa-da7f1c7a9a7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:23:45.662119 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:45.782999 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f779f10b-1eae-4f64-8b3e-b5edf8910641 req-3fc91c0f-8803-43ce-ad9c-a6a55d1b9dba tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:45.785927 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f779f10b-1eae-4f64-8b3e-b5edf8910641 req-3fc91c0f-8803-43ce-ad9c-a6a55d1b9dba tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0995221 Nov 18 18:23:45.788565 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8694df99-13ee-45f4-b82d-23add3f16c40', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7f5eeb8c-4f5d-4aff-8212-8c2f004ba255'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:23:45.790853 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9de8aabb-47d8-4591-9dcd-83037bee4030" -d '{"events": [{"server_uuid": "8694df99-13ee-45f4-b82d-23add3f16c40", "name": "network-vif-plugged", "status": "completed", "tag": "7f5eeb8c-4f5d-4aff-8212-8c2f004ba255"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:23:45.803693 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:45.808694 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:45.857341 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f779f10b-1eae-4f64-8b3e-b5edf8910641 req-95e77a4b-175f-45b0-9302-8bfb11259d0e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0645514 Nov 18 18:23:45.877065 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:23:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6be167fe-0962-43ee-9946-de814ba7b703 x-openstack-request-id: req-6be167fe-0962-43ee-9946-de814ba7b703 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:23:45.877354 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8694df99-13ee-45f4-b82d-23add3f16c40", "name": "network-vif-plugged", "status": "completed", "tag": "7f5eeb8c-4f5d-4aff-8212-8c2f004ba255", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:23:45.877606 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-6be167fe-0962-43ee-9946-de814ba7b703 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:23:45.878045 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8694df99-13ee-45f4-b82d-23add3f16c40', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7f5eeb8c-4f5d-4aff-8212-8c2f004ba255', 'code': 200} Nov 18 18:23:45.891006 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:46.182647 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973e32ef-6514-44db-9881-3d960311b733 req-570e7a9d-adfa-4acc-b7ac-ee8bdb7d2ec2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:46.184514 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-973e32ef-6514-44db-9881-3d960311b733 req-570e7a9d-adfa-4acc-b7ac-ee8bdb7d2ec2 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 1099 time: 0.1088109 Nov 18 18:23:46.298844 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-973e32ef-6514-44db-9881-3d960311b733 req-0ee5d9c0-fb0c-4d98-a8a9-88b8d79e706e service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0943694 Nov 18 18:23:46.455629 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device afc98e3b-9711-4de0-a528-319542997a98 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:46.521980 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74a2ce08-d714-40a8-8d7e-e5ae6418bc67 req-44ef4728-4351-4c3d-a48a-bbf07a80be0f tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:46.534188 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-74a2ce08-d714-40a8-8d7e-e5ae6418bc67 req-44ef4728-4351-4c3d-a48a-bbf07a80be0f tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 946 time: 0.1173401 Nov 18 18:23:46.605822 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port afc98e3b-9711-4de0-a528-319542997a98 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:46.606162 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:46.673361 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-74a2ce08-d714-40a8-8d7e-e5ae6418bc67 req-4bbb33f7-3b70-47d0-883a-20c7b8ca04f9 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1363218 Nov 18 18:23:46.936242 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2931276b-60be-4204-9afe-d39edf4dc6ff req-8e8e2de6-01b7-4ff8-9fb9-c3f77802e70e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:46.937753 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2931276b-60be-4204-9afe-d39edf4dc6ff req-8e8e2de6-01b7-4ff8-9fb9-c3f77802e70e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 1098 time: 0.1585145 Nov 18 18:23:47.236816 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ff8f296-3113-4b89-9e66-c6a988810893 req-0e94c24d-5dbd-4418-96e9-a0dbef0ad306 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:47.236816 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2ff8f296-3113-4b89-9e66-c6a988810893 req-0e94c24d-5dbd-4418-96e9-a0dbef0ad306 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.3684597 Nov 18 18:23:47.295439 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2931276b-60be-4204-9afe-d39edf4dc6ff req-649b0aa5-c61c-4a4c-95f2-5655ad2a13ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:47.296982 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2931276b-60be-4204-9afe-d39edf4dc6ff req-649b0aa5-c61c-4a4c-95f2-5655ad2a13ec service neutron] 10.222.0.31 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 921 time: 0.3401692 Nov 18 18:23:47.323711 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39463713-4128-4372-b9b3-6dca6bde1201 req-878c3b2b-369c-4ede-bbca-ade0e927ac52 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:47.332490 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-39463713-4128-4372-b9b3-6dca6bde1201 req-878c3b2b-369c-4ede-bbca-ade0e927ac52 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.3140481 Nov 18 18:23:47.423603 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2931276b-60be-4204-9afe-d39edf4dc6ff req-8ee1cb71-b9fb-4064-b8be-d287a250fdc2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b627bee7-04b0-4a31-8ff0-84f976c65917 HTTP/1.1" status: 200 len: 217 time: 0.0783234 Nov 18 18:23:47.577459 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2ff8f296-3113-4b89-9e66-c6a988810893 req-88991936-cb22-40f8-986b-1f736014c929 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3399916 Nov 18 18:23:47.599788 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-39463713-4128-4372-b9b3-6dca6bde1201 req-7f595ad3-9852-4d7a-975f-c3c99e5a7999 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2634761 Nov 18 18:23:47.604131 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2931276b-60be-4204-9afe-d39edf4dc6ff req-c0bae5c8-341c-4de0-b1ed-738adedd1c28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:47.606679 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2931276b-60be-4204-9afe-d39edf4dc6ff req-c0bae5c8-341c-4de0-b1ed-738adedd1c28 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 HTTP/1.1" status: 200 len: 859 time: 0.1705005 Nov 18 18:23:47.649968 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2931276b-60be-4204-9afe-d39edf4dc6ff req-dd154ce2-98c4-44b4-9ec6-e478f3465204 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0290561 Nov 18 18:23:47.790633 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2931276b-60be-4204-9afe-d39edf4dc6ff req-05aa2ad5-37dc-4744-a690-7eb620598b2f service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1314301 Nov 18 18:23:47.833037 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a55bacc-8da5-4209-9145-dd3a3d76041d req-520d6817-56b7-462c-8936-f9971a5aedc9 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:47.841629 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4a55bacc-8da5-4209-9145-dd3a3d76041d req-520d6817-56b7-462c-8936-f9971a5aedc9 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 946 time: 0.0828359 Nov 18 18:23:47.945912 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4a55bacc-8da5-4209-9145-dd3a3d76041d req-15b4dd9b-1f18-4786-8b1f-a2b858a9c983 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1002285 Nov 18 18:23:47.971434 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2931276b-60be-4204-9afe-d39edf4dc6ff req-be71a882-6736-4746-bebd-6a833e4ad2ec service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1708419 Nov 18 18:23:48.806818 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-467cba05-6281-4c2b-93d0-112c791826fe req-864e978e-2554-4a7e-af3d-88a27cb261bf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:48.808339 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-467cba05-6281-4c2b-93d0-112c791826fe req-864e978e-2554-4a7e-af3d-88a27cb261bf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0878754 Nov 18 18:23:48.816582 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79f59cf4-a4c4-4661-901f-30169afd13f5 req-09c22468-0d14-4a54-afb4-c80818cbf8e5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:48.818832 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-79f59cf4-a4c4-4661-901f-30169afd13f5 req-09c22468-0d14-4a54-afb4-c80818cbf8e5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0704572 Nov 18 18:23:48.901938 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-467cba05-6281-4c2b-93d0-112c791826fe req-e6b59dca-fa0d-47f7-85f0-7009635a35e3 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0819471 Nov 18 18:23:48.908476 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-79f59cf4-a4c4-4661-901f-30169afd13f5 req-fe174fae-53d9-4119-911f-a423859a3517 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0815699 Nov 18 18:23:49.066899 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d552c9-b3b1-4f37-81ca-33f7a257ade4 req-66334200-ce66-4942-9b0e-aec0c2a5f646 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:49.068564 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-28d552c9-b3b1-4f37-81ca-33f7a257ade4 req-66334200-ce66-4942-9b0e-aec0c2a5f646 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 946 time: 0.0569050 Nov 18 18:23:49.122512 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-28d552c9-b3b1-4f37-81ca-33f7a257ade4 req-b5752f1b-5d10-48d5-b175-dc1048135d8d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473800 Nov 18 18:23:50.070672 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a88b0f-2b52-4abd-9c4d-92e0708d7b06 req-aa89b96f-24f5-492c-9053-9b20797f7512 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:50.072258 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e5a88b0f-2b52-4abd-9c4d-92e0708d7b06 req-aa89b96f-24f5-492c-9053-9b20797f7512 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0891073 Nov 18 18:23:50.085182 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fdc8999-f1db-40bf-872a-da03ff637848 req-5e5698b6-744e-4e58-8286-5e23f4ff2c8c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:50.086697 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0fdc8999-f1db-40bf-872a-da03ff637848 req-5e5698b6-744e-4e58-8286-5e23f4ff2c8c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0945485 Nov 18 18:23:50.157564 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e5a88b0f-2b52-4abd-9c4d-92e0708d7b06 req-3131677e-dde9-4916-8925-a8c7e393ac27 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698698 Nov 18 18:23:50.165436 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0fdc8999-f1db-40bf-872a-da03ff637848 req-a4767593-e6d3-4227-b147-ab526d81cdde tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0638540 Nov 18 18:23:50.480008 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:23:51.127317 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:51.328835 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9b9cd72-37d4-49da-9162-1187fc943ab7 req-e5912a1c-3d5b-43da-932f-fabadb2857e0 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:51.330387 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c9b9cd72-37d4-49da-9162-1187fc943ab7 req-e5912a1c-3d5b-43da-932f-fabadb2857e0 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0881362 Nov 18 18:23:51.349487 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bc721fb-efea-45f5-a3ee-6b8dbcc4697d req-160a450b-0654-4c63-aee4-97a0d31d6e82 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:51.351556 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2bc721fb-efea-45f5-a3ee-6b8dbcc4697d req-160a450b-0654-4c63-aee4-97a0d31d6e82 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0959558 Nov 18 18:23:51.423302 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c9b9cd72-37d4-49da-9162-1187fc943ab7 req-3efaff1c-2176-4cb7-b0dc-ba6ee9c3bfdf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0864074 Nov 18 18:23:51.434162 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2bc721fb-efea-45f5-a3ee-6b8dbcc4697d req-c8c36b98-9772-42ff-a1e7-0a8d23e61928 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0747507 Nov 18 18:23:52.659349 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b212a927-4508-405e-893d-7f688a82c6ff req-5e3c6954-9045-4ac8-9ad3-5dcda362480c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:52.668663 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b212a927-4508-405e-893d-7f688a82c6ff req-5e3c6954-9045-4ac8-9ad3-5dcda362480c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1364512 Nov 18 18:23:52.703974 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04c2d684-8d31-49a2-b04a-ad74d215a559 req-2c9fcd44-dd94-4d48-87cd-4aaa3cd54549 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:52.710892 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-04c2d684-8d31-49a2-b04a-ad74d215a559 req-2c9fcd44-dd94-4d48-87cd-4aaa3cd54549 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1232874 Nov 18 18:23:52.837222 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b212a927-4508-405e-893d-7f688a82c6ff req-d7a2da7a-e314-411f-a445-64750bae47f5 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1516418 Nov 18 18:23:52.837222 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-04c2d684-8d31-49a2-b04a-ad74d215a559 req-f5f43623-0e95-403c-bd05-d3f826363d12 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1252587 Nov 18 18:23:53.494413 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd04e83-622a-41f8-bb9a-ab5aeef522d0 req-2c951647-bd53-41c6-bcfb-a89bf7d17940 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:53.503471 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bfd04e83-622a-41f8-bb9a-ab5aeef522d0 req-2c951647-bd53-41c6-bcfb-a89bf7d17940 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1720695 Nov 18 18:23:53.560647 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bfd04e83-622a-41f8-bb9a-ab5aeef522d0 req-34e4fe42-cd2b-4af7-aff1-984e9943eb70 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0557878 Nov 18 18:23:53.955853 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9990536c-0b5d-493f-a329-d00b87bf145c req-f348e939-b335-49d4-868b-6f921241fb96 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:53.963683 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9990536c-0b5d-493f-a329-d00b87bf145c req-f348e939-b335-49d4-868b-6f921241fb96 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0628359 Nov 18 18:23:54.032057 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9990536c-0b5d-493f-a329-d00b87bf145c req-da46a3bb-1e16-4943-a14c-b934bfabeed7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0615578 Nov 18 18:23:54.157872 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27d0d3b2-e486-4ef1-9dec-06c95e60dfca req-351c75e1-7ee8-4a41-9889-dcd52969fd86 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:54.167142 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-27d0d3b2-e486-4ef1-9dec-06c95e60dfca req-351c75e1-7ee8-4a41-9889-dcd52969fd86 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0758426 Nov 18 18:23:54.223221 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-27d0d3b2-e486-4ef1-9dec-06c95e60dfca req-c6611592-9e5f-4bf1-a1f2-e9ea0ca35278 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0548422 Nov 18 18:23:54.415368 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-7f9b106d-92db-4437-ac48-1aaacb72a8bc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:54.416962 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-7f9b106d-92db-4437-ac48-1aaacb72a8bc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/networks?id=c5332eb5-c186-4bcf-89d9-eb78be973548 HTTP/1.1" status: 200 len: 815 time: 0.1176314 Nov 18 18:23:54.433185 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-a084ad3b-e3e9-462a-b9f0-04271b0dee82 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/quotas/46a1cb48de6e4f43a563f40fd92f0bf0 HTTP/1.1" status: 200 len: 375 time: 0.0098443 Nov 18 18:23:54.489492 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-1dd61b1f-92e8-4dd6-beec-b2ccb8712c36 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=46a1cb48de6e4f43a563f40fd92f0bf0&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0480559 Nov 18 18:23:54.627104 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-9915d94a-96da-4026-815d-d952b7da939c service neutron] 10.222.0.82 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1224902 Nov 18 18:23:54.794207 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-9c9a8e0d-d382-48d9-8814-fe4cc7d27db3 service neutron] 10.222.0.82 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1663105 Nov 18 18:23:54.804937 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f390204-c6d9-4661-a11e-75d69e57f041 req-4bbf88b5-d2c2-4e35-afd2-34589a2219a0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:54.806696 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6f390204-c6d9-4661-a11e-75d69e57f041 req-4bbf88b5-d2c2-4e35-afd2-34589a2219a0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1483603 Nov 18 18:23:54.861525 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6f390204-c6d9-4661-a11e-75d69e57f041 req-1d5a63e0-12d3-45d1-b648-9d90edb75327 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489807 Nov 18 18:23:55.028629 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-303f6443-adeb-4209-8cb9-72697540632a req-308428fb-732d-486d-a016-be9057c6db41 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 210 time: 0.0494976 Nov 18 18:23:55.224402 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f5cbd1-be99-42bf-b635-33bb01ef2a02 req-d2a9b4ed-ac83-4259-800c-d0783928e1eb tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:55.231853 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-47f5cbd1-be99-42bf-b635-33bb01ef2a02 req-d2a9b4ed-ac83-4259-800c-d0783928e1eb tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1104345 Nov 18 18:23:55.304580 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-47f5cbd1-be99-42bf-b635-33bb01ef2a02 req-9660745b-d3e3-4a33-b17c-2133142825e9 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717411 Nov 18 18:23:55.378927 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ba5d84-b01a-4f4b-8f2a-d71c981e4a52 req-16f05473-75da-456b-8fdc-9ce2b088bf61 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:55.380457 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a4ba5d84-b01a-4f4b-8f2a-d71c981e4a52 req-16f05473-75da-456b-8fdc-9ce2b088bf61 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0509865 Nov 18 18:23:55.503812 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a4ba5d84-b01a-4f4b-8f2a-d71c981e4a52 req-ccc8a340-b770-4488-9229-2665def6aff6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1000719 Nov 18 18:23:55.993413 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3042dae4-f311-459f-b1b5-77e35397f600 req-b6aeb492-645e-478b-8622-d3a547a2908e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:55.994906 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3042dae4-f311-459f-b1b5-77e35397f600 req-b6aeb492-645e-478b-8622-d3a547a2908e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0545714 Nov 18 18:23:56.050833 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3042dae4-f311-459f-b1b5-77e35397f600 req-47d3f8ce-ec4d-4839-a738-b493afc006bb tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480194 Nov 18 18:23:56.124059 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-61b11d90-7577-44c5-84e7-01fb9a367718 req-7ccadd44-619e-464b-98c5-64a3d1d5950b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 210 time: 0.0298352 Nov 18 18:23:56.433723 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ec7114-8646-45d4-82b9-f0c9b2d30db0 req-b367028e-aa6e-4da9-bc12-68f3892d2d09 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:56.435209 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-07ec7114-8646-45d4-82b9-f0c9b2d30db0 req-b367028e-aa6e-4da9-bc12-68f3892d2d09 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0514143 Nov 18 18:23:56.560650 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-07ec7114-8646-45d4-82b9-f0c9b2d30db0 req-4d82a805-bd40-4cee-a737-1c54c4c7d612 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1097980 Nov 18 18:23:56.597566 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-a1184935-69ff-4baf-98f9-bc47584e8e05 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:56.599309 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-a1184935-69ff-4baf-98f9-bc47584e8e05 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.31 "GET /v2.0/networks?id=c5332eb5-c186-4bcf-89d9-eb78be973548 HTTP/1.1" status: 200 len: 815 time: 0.1586430 Nov 18 18:23:56.619548 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Request body: {'port': {'device_id': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'admin_state_up': True, 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:56.774957 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96288d39-3481-49f2-9a45-aad429f48401 req-c5a93d6d-f32e-4cad-b373-6d2b26d5679d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:56.776603 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-96288d39-3481-49f2-9a45-aad429f48401 req-c5a93d6d-f32e-4cad-b373-6d2b26d5679d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1522012 Nov 18 18:23:56.901444 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Made reservation on behalf of 46a1cb48de6e4f43a563f40fd92f0bf0 for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:23:56.908212 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:56.936465 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-96288d39-3481-49f2-9a45-aad429f48401 req-4d5718e0-7202-4f01-bf32-c05c333ab200 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1412439 Nov 18 18:23:57.060198 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Allocated IP 172.20.0.14 (c5332eb5-c186-4bcf-89d9-eb78be973548/24097eeb-7eeb-4617-b83d-a363de5de9b1/e535328b-e6c3-4630-a314-5bd8ccdaad80) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:23:57.234387 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6399afb6-ef50-4fa0-bd03-d6f3e476fc2c req-70c2c266-c878-4790-ace8-9318c551fd16 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 210 time: 0.0376008 Nov 18 18:23:57.257284 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66520c6d-286d-4af9-b8b9-528e9511e3f0 req-00822f5e-2d61-424a-bcb5-fa14989d30df tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:57.258749 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-66520c6d-286d-4af9-b8b9-528e9511e3f0 req-00822f5e-2d61-424a-bcb5-fa14989d30df tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1315987 Nov 18 18:23:57.278921 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b8ded38f-97b4-485b-9845-705c1fb9701d details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:23:57.283083 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:57.333769 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-66520c6d-286d-4af9-b8b9-528e9511e3f0 req-c520ff0a-84c6-43f6-951a-63892a774579 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0677314 Nov 18 18:23:57.349461 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:57.383058 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b8ded38f-97b4-485b-9845-705c1fb9701d,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:57.395881 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'port_id': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'mac_address': 'fa:16:3e:9b:a4:2d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1342, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:23:57.397450 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Network c5332eb5-c186-4bcf-89d9-eb78be973548 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:23:57.400777 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:23:57.404518 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:23:57.431246 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event updated for resources: {'Port': ['ID=e535328b-e6c3-4630-a314-5bd8ccdaad80,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:57.436541 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:57.451235 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id b8ded38f-97b4-485b-9845-705c1fb9701d {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:23:57.476304 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b8ded38f-97b4-485b-9845-705c1fb9701d,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:57.481409 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:57.488361 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:57.489542 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:57.534188 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-2185def4-91b4-425e-ba11-c999c10654a8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9118955 Nov 18 18:23:57.562822 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Request body: {'port': {'device_id': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:23:57.590416 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=b8ded38f-97b4-485b-9845-705c1fb9701d,revision_number=6']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:57.652733 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:57.755817 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['b8ded38f-97b4-485b-9845-705c1fb9701d'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:23:57.800320 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-b666e960-86cb-42a5-aba1-b7d541be05b9 None None] Provisioning complete for port e535328b-e6c3-4630-a314-5bd8ccdaad80 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:57.801083 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-b666e960-86cb-42a5-aba1-b7d541be05b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:57.848679 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2c3dc2-7118-4a1a-b57b-5203cb7aedd2 req-78e77aae-e979-4ff8-919c-b86bdbd9b1b7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:57.850146 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1d2c3dc2-7118-4a1a-b57b-5203cb7aedd2 req-78e77aae-e979-4ff8-919c-b86bdbd9b1b7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1282692 Nov 18 18:23:57.854466 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-b666e960-86cb-42a5-aba1-b7d541be05b9 None None] Port e535328b-e6c3-4630-a314-5bd8ccdaad80 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:23:57.979849 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1d2c3dc2-7118-4a1a-b57b-5203cb7aedd2 req-a26d8fa5-6a68-4f3c-ab45-50eca4a20bdf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1115673 Nov 18 18:23:58.336565 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235a7afc-a131-475c-aaa8-f921dd14fff3 req-b8ba095b-0859-4b19-954b-377883f39e3d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:58.337875 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-235a7afc-a131-475c-aaa8-f921dd14fff3 req-b8ba095b-0859-4b19-954b-377883f39e3d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 944 time: 0.3128619 Nov 18 18:23:58.347919 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e535328b-e6c3-4630-a314-5bd8ccdaad80 {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:23:58.358110 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:58.401427 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Transition to ACTIVE for port object e535328b-e6c3-4630-a314-5bd8ccdaad80 will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:23:58.409173 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-93cf2bd7-ad4e-4661-a0b1-53cafcc4b89c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1510703379&fields=id&tenant_id=029e580af1e3498aa00c86f5ce660a80 HTTP/1.1" status: 200 len: 267 time: 0.3128905 Nov 18 18:23:58.416813 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:58.489652 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-235a7afc-a131-475c-aaa8-f921dd14fff3 req-ef168a1f-d07b-4ac2-9514-d49441a0ac7c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1365991 Nov 18 18:23:58.566816 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Pushing event updated for resources: {'Port': ['ID=e535328b-e6c3-4630-a314-5bd8ccdaad80,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:58.700885 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-9871132b-a181-4251-b845-e8e19c55cf61 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:58.702389 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-9871132b-a181-4251-b845-e8e19c55cf61 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/networks?id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a HTTP/1.1" status: 200 len: 807 time: 0.2758472 Nov 18 18:23:58.746117 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-681ee7c5-4040-4c9d-97f1-600d78306bde tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/quotas/029e580af1e3498aa00c86f5ce660a80 HTTP/1.1" status: 200 len: 375 time: 0.0247366 Nov 18 18:23:58.761574 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7100e6b0-d872-43d7-b836-c8da4089a1fe req-17329af0-4ac5-4353-a5f3-807c11c5d9d8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:58.763114 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7100e6b0-d872-43d7-b836-c8da4089a1fe req-17329af0-4ac5-4353-a5f3-807c11c5d9d8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1427321 Nov 18 18:23:58.785128 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Attempting to bind port e535328b-e6c3-4630-a314-5bd8ccdaad80 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:23:58.785475 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Attempting to bind port e535328b-e6c3-4630-a314-5bd8ccdaad80 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:23:58.785814 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Attempting to bind port e535328b-e6c3-4630-a314-5bd8ccdaad80 on network c5332eb5-c186-4bcf-89d9-eb78be973548 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:58.820193 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Port e535328b-e6c3-4630-a314-5bd8ccdaad80 on network c5332eb5-c186-4bcf-89d9-eb78be973548 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:23:58.820514 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Attempting to bind port e535328b-e6c3-4630-a314-5bd8ccdaad80 on network c5332eb5-c186-4bcf-89d9-eb78be973548 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:23:58.834842 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:23:58.835177 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Checking segment: {'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:23:58.835563 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Bound using segment: {'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:23:58.836016 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Bound port: e535328b-e6c3-4630-a314-5bd8ccdaad80, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6a4ec92d-4943-4121-a1de-1611106781cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1305, 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:23:58.836370 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:58.877265 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7100e6b0-d872-43d7-b836-c8da4089a1fe req-369032e7-1ac6-4558-bee0-858e6a8372a5 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1034703 Nov 18 18:23:58.883103 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-0c496f70-f956-45c3-9542-5da075717a3f tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=029e580af1e3498aa00c86f5ce660a80&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1305993 Nov 18 18:23:59.036746 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] For port e535328b-e6c3-4630-a314-5bd8ccdaad80, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:23:59.062812 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] For port e535328b-e6c3-4630-a314-5bd8ccdaad80, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:23:59.068127 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-26e4829d-b3fd-4acc-be29-6a025de0d605 service neutron] 10.222.0.82 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1588914 Nov 18 18:23:59.070498 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:59.079102 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4c84784-381b-44ef-ac40-11eeb77c2dc9 req-3e6d1af2-3dae-431b-b1a6-d6ba77992bfa tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:59.080580 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a4c84784-381b-44ef-ac40-11eeb77c2dc9 req-3e6d1af2-3dae-431b-b1a6-d6ba77992bfa tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1267080 Nov 18 18:23:59.152596 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:59.153215 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:59.154535 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] 10.222.0.31 "PUT /v2.0/ports/e535328b-e6c3-4630-a314-5bd8ccdaad80 HTTP/1.1" status: 200 len: 1094 time: 1.6043291 Nov 18 18:23:59.163370 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:23:59.165676 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a285c586-5c04-4a9e-a9de-29bfe5a7db05" -d '{"events": [{"name": "network-changed", "server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:23:59.238131 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f66660d9-f283-4abf-9586-bb14dfc64f90 service neutron] Pushing event updated for resources: {'Port': ['ID=e535328b-e6c3-4630-a314-5bd8ccdaad80,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:59.251555 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a4c84784-381b-44ef-ac40-11eeb77c2dc9 req-15a5b5f9-88a1-47c0-abb8-902f79a92905 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1555259 Nov 18 18:23:59.282071 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-1971882b-b74e-488e-9d2e-6fb0bb7c9a06 service neutron] 10.222.0.82 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2005038 Nov 18 18:23:59.291568 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b8ded38f-97b4-485b-9845-705c1fb9701d up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:23:59.373414 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port b8ded38f-97b4-485b-9845-705c1fb9701d triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:23:59.373794 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:59.423566 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-d753075d-6458-49c8-ac67-37f79a9e4855 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:59.425269 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-d753075d-6458-49c8-ac67-37f79a9e4855 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=46a1cb48de6e4f43a563f40fd92f0bf0&device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 1097 time: 0.1344538 Nov 18 18:23:59.456002 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95c7602-4c58-46d2-aa99-e7856649703a req-2ae214fc-f897-41e0-b73c-1b1107866af7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:59.457594 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b95c7602-4c58-46d2-aa99-e7856649703a req-2ae214fc-f897-41e0-b73c-1b1107866af7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1112716 Nov 18 18:23:59.486709 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:59.507821 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-5b524727-9120-499d-859b-10f0348bfc4d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80 HTTP/1.1" status: 200 len: 217 time: 0.0486903 Nov 18 18:23:59.515314 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:23:59.518028 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01ddace7-a3ec-4a54-98ff-53ec478ab1b0" -d '{"events": [{"server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "name": "network-vif-plugged", "status": "completed", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:23:59.533725 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b8ded38f-97b4-485b-9845-705c1fb9701d,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:23:59.539806 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:23:59.561728 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b95c7602-4c58-46d2-aa99-e7856649703a req-432c43f5-56c7-4bbe-8d7d-e2b54eae8b3d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0907888 Nov 18 18:23:59.655834 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:23:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-864953bb-7e8d-4344-9636-a0af9a4ae6cf x-openstack-request-id: req-864953bb-7e8d-4344-9636-a0af9a4ae6cf {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:23:59.656593 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:23:59.657303 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-864953bb-7e8d-4344-9636-a0af9a4ae6cf {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:23:59.657871 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'status': 'completed', 'code': 200} Nov 18 18:23:59.676289 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-069d6c06-6c47-4df0-819c-3985673f437f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:59.678700 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=b8ded38f-97b4-485b-9845-705c1fb9701d,revision_number=7']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:23:59.683060 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-069d6c06-6c47-4df0-819c-3985673f437f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24097eeb-7eeb-4617-b83d-a363de5de9b1 HTTP/1.1" status: 200 len: 854 time: 0.1452827 Nov 18 18:23:59.723955 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:23:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c790345e-b8e8-4c23-89da-833ceefad546 x-openstack-request-id: req-c790345e-b8e8-4c23-89da-833ceefad546 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:23:59.724492 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "name": "network-vif-plugged", "status": "completed", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:23:59.724938 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-c790345e-b8e8-4c23-89da-833ceefad546 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:23:59.725501 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'code': 200} Nov 18 18:23:59.825141 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-73e501ee-3159-4936-ad0f-789dc69830ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:59.827170 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-73e501ee-3159-4936-ad0f-789dc69830ba service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c5332eb5-c186-4bcf-89d9-eb78be973548&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1293499 Nov 18 18:23:59.837952 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2ad67446-ce6d-4156-b571-740b724d4c67 req-b8c8294f-ce9a-4034-8904-2a87e560ba3e tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 210 time: 0.0462794 Nov 18 18:23:59.915447 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-336dc9ab-6b34-4f5e-b155-9fb3cbdcdc46 req-686068b0-a473-4eab-b2e0-014414bab281 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:23:59.924933 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-336dc9ab-6b34-4f5e-b155-9fb3cbdcdc46 req-686068b0-a473-4eab-b2e0-014414bab281 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1886375 Nov 18 18:24:00.104040 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-336dc9ab-6b34-4f5e-b155-9fb3cbdcdc46 req-0ad68c75-42f7-4b0f-a183-a1bcbc9efacd tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1771193 Nov 18 18:24:00.120309 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89941c7d-170b-428c-8392-a25164e43a46 req-7b8af8f6-a401-4624-820c-63daf9809b16 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:00.121565 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-89941c7d-170b-428c-8392-a25164e43a46 req-7b8af8f6-a401-4624-820c-63daf9809b16 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1559489 Nov 18 18:24:00.123551 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-4c4b37a6-7ffe-4011-aeb3-17d1484e9780 service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2816045 Nov 18 18:24:00.289544 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-89941c7d-170b-428c-8392-a25164e43a46 req-61310a86-caa9-460e-be50-11195dd4fc01 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1620705 Nov 18 18:24:00.342776 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae595d55-ac91-4396-8796-ffd6ddb00a20 req-4f23da6c-4d74-4fca-b4a0-0c983b85503e service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2008910 Nov 18 18:24:00.404932 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-902730bd-aaf8-4e96-a2c0-1eaa322ab7e0 req-e34e5f7f-cbd0-402a-b4da-21d30d0800ad tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:00.410284 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-902730bd-aaf8-4e96-a2c0-1eaa322ab7e0 req-e34e5f7f-cbd0-402a-b4da-21d30d0800ad tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0722251 Nov 18 18:24:00.481260 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-902730bd-aaf8-4e96-a2c0-1eaa322ab7e0 req-c6f6e8b0-987e-4ce8-94c3-f42b4aa294e9 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0676260 Nov 18 18:24:00.511217 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a285c586-5c04-4a9e-a9de-29bfe5a7db05 req-38c911b3-fc00-4c13-bbcf-f440adb7ea0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:00.513054 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a285c586-5c04-4a9e-a9de-29bfe5a7db05 req-38c911b3-fc00-4c13-bbcf-f440adb7ea0d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=46a1cb48de6e4f43a563f40fd92f0bf0&device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 1097 time: 0.0555382 Nov 18 18:24:00.644853 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a285c586-5c04-4a9e-a9de-29bfe5a7db05 req-26fc1571-0cd0-4b58-bf0c-2fe198d63a0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:00.648178 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a285c586-5c04-4a9e-a9de-29bfe5a7db05 req-26fc1571-0cd0-4b58-bf0c-2fe198d63a0c service neutron] 10.222.0.31 "GET /v2.0/networks?id=c5332eb5-c186-4bcf-89d9-eb78be973548 HTTP/1.1" status: 200 len: 917 time: 0.1248071 Nov 18 18:24:00.730449 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a285c586-5c04-4a9e-a9de-29bfe5a7db05 req-c6cb7ecd-4b83-4971-8be5-5f9989e0be5c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80 HTTP/1.1" status: 200 len: 217 time: 0.0707958 Nov 18 18:24:00.754376 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4617b8e4-49bd-49aa-8548-84faf195a446 req-c918e140-8311-4cdf-8324-624f1d01ec3a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:00.755956 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4617b8e4-49bd-49aa-8548-84faf195a446 req-c918e140-8311-4cdf-8324-624f1d01ec3a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1068249 Nov 18 18:24:00.842998 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a285c586-5c04-4a9e-a9de-29bfe5a7db05 req-c728baf2-6517-4dc1-9bd9-50305e8dca56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:00.844481 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a285c586-5c04-4a9e-a9de-29bfe5a7db05 req-c728baf2-6517-4dc1-9bd9-50305e8dca56 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24097eeb-7eeb-4617-b83d-a363de5de9b1 HTTP/1.1" status: 200 len: 854 time: 0.0876420 Nov 18 18:24:00.849157 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4617b8e4-49bd-49aa-8548-84faf195a446 req-ea6b6783-77a2-4e7a-8a0f-f910703915e9 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843310 Nov 18 18:24:00.909757 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a285c586-5c04-4a9e-a9de-29bfe5a7db05 req-416594aa-929f-4258-a71f-42208df8200c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:00.911403 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a285c586-5c04-4a9e-a9de-29bfe5a7db05 req-416594aa-929f-4258-a71f-42208df8200c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c5332eb5-c186-4bcf-89d9-eb78be973548&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0536056 Nov 18 18:24:00.959834 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dacdd32c-14a0-4ecc-a5bd-9f68f1b2bcc5 req-cb72b034-8aad-4c35-aafa-b61fc81de329 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 210 time: 0.0358920 Nov 18 18:24:01.053395 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a285c586-5c04-4a9e-a9de-29bfe5a7db05 req-2de12b4d-ab36-4137-a3da-27bc3bceb1ab service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1208806 Nov 18 18:24:01.181478 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a285c586-5c04-4a9e-a9de-29bfe5a7db05 req-da598f3e-4f2b-4c76-a6dc-85b4c4157e1a service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1204236 Nov 18 18:24:01.276493 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ed5a9ec-c357-4ba4-9c69-7f24e10beecb req-0a373c6f-50cb-43a9-bf25-f841250cfddc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:01.278067 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5ed5a9ec-c357-4ba4-9c69-7f24e10beecb req-0a373c6f-50cb-43a9-bf25-f841250cfddc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0525377 Nov 18 18:24:01.422631 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5ed5a9ec-c357-4ba4-9c69-7f24e10beecb req-9c4c703c-63cd-4628-b4a8-9e1ade921324 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1381023 Nov 18 18:24:01.473240 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-d6651a04-d80d-449b-ba53-0bef1b2a79a5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:01.479977 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-d6651a04-d80d-449b-ba53-0bef1b2a79a5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.31 "GET /v2.0/networks?id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a HTTP/1.1" status: 200 len: 807 time: 0.1885197 Nov 18 18:24:01.578594 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c891a3d-4d78-4b58-aff3-68521ce21ab6 req-098ca590-3475-4dbc-a644-819429ad69b5 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:01.580240 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9c891a3d-4d78-4b58-aff3-68521ce21ab6 req-098ca590-3475-4dbc-a644-819429ad69b5 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0903904 Nov 18 18:24:01.648049 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-baaea5f1-f826-4a9c-9498-f584af0fe576 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=029e580af1e3498aa00c86f5ce660a80 HTTP/1.1" status: 200 len: 380 time: 0.1283400 Nov 18 18:24:01.671410 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Request body: {'port': {'device_id': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'admin_state_up': True, 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'security_groups': ['7d840379-2de9-4453-883d-266a12b03984']}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:24:01.711832 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9c891a3d-4d78-4b58-aff3-68521ce21ab6 req-f2a14a47-d9b4-4578-bff5-056e67ce5dca tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1080399 Nov 18 18:24:01.721458 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377f5cef-3ad1-463f-bada-993f6ebba297 req-8a82d19f-9f10-4012-90c2-f185524c9452 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:01.722971 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-377f5cef-3ad1-463f-bada-993f6ebba297 req-8a82d19f-9f10-4012-90c2-f185524c9452 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1575637 Nov 18 18:24:01.823409 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-377f5cef-3ad1-463f-bada-993f6ebba297 req-76e0998a-ec46-491a-8316-57357180465b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0935409 Nov 18 18:24:01.848697 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Made reservation on behalf of 029e580af1e3498aa00c86f5ce660a80 for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:24:01.852962 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:02.020158 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6a192ee-70d1-488f-b680-42c04b1514c1 req-349e30cc-bdd1-4861-916d-9d9a3d1cd402 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:02.024410 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e6a192ee-70d1-488f-b680-42c04b1514c1 req-349e30cc-bdd1-4861-916d-9d9a3d1cd402 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1037440 Nov 18 18:24:02.030569 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Allocated IP 172.20.0.10 (584f2b3a-f3ea-4f7c-bcc9-711159cffa8a/cac1be0a-3676-49bd-8292-3623cc0fc8b1/85e36ba2-dd4d-47c9-b794-f9104af3235f) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:24:02.081649 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1042e569-440c-4a2a-b711-bc83854981e6 req-a773b34e-cf69-43b0-8655-4724dbb0e141 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 210 time: 0.0409374 Nov 18 18:24:02.120415 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e6a192ee-70d1-488f-b680-42c04b1514c1 req-11a72ab8-9891-4936-9bb6-02cb67a99810 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0919435 Nov 18 18:24:02.227902 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:02.261477 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:02.306133 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:24:02.311808 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:24:02.320323 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:24:02.323753 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event updated for resources: {'Port': ['ID=85e36ba2-dd4d-47c9-b794-f9104af3235f,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:02.378844 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:02.379484 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:02.408109 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-2cdcaf69-98c3-45b6-8016-14e019012ec0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7464828 Nov 18 18:24:02.437315 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Request body: {'port': {'device_id': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:24:02.589269 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:02.667513 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-779cad8b-baf6-4bac-b35e-c357ab52c102 req-917fe5ce-2eb7-4bfd-9df5-b9a5eaf1d64e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:02.670288 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-779cad8b-baf6-4bac-b35e-c357ab52c102 req-917fe5ce-2eb7-4bfd-9df5-b9a5eaf1d64e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1248214 Nov 18 18:24:02.692790 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-d9b8d7af-864e-4fb3-99bb-09a181d70e73 None None] Provisioning complete for port 85e36ba2-dd4d-47c9-b794-f9104af3235f triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:24:02.693411 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d9b8d7af-864e-4fb3-99bb-09a181d70e73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:02.727519 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-d9b8d7af-864e-4fb3-99bb-09a181d70e73 None None] Port 85e36ba2-dd4d-47c9-b794-f9104af3235f cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:24:02.859337 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-779cad8b-baf6-4bac-b35e-c357ab52c102 req-b4d490b2-dabb-41a9-a912-d2a0113e0a9e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1720479 Nov 18 18:24:02.920557 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1da9742a-cd0c-4021-b097-d701092ebda0 req-683aacbf-4eea-4454-ab7b-753d04d90770 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:02.921649 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1da9742a-cd0c-4021-b097-d701092ebda0 req-683aacbf-4eea-4454-ab7b-753d04d90770 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1304877 Nov 18 18:24:03.060813 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1da9742a-cd0c-4021-b097-d701092ebda0 req-1926e4b4-9732-4fb6-b58d-522f54b5cf5e tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0971723 Nov 18 18:24:03.070307 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4f794f8-b4ee-4972-81b8-be7f65e72a8d req-e0976db8-0be2-4cc2-92a4-c21a9be6144b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:03.080708 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b4f794f8-b4ee-4972-81b8-be7f65e72a8d req-e0976db8-0be2-4cc2-92a4-c21a9be6144b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1527746 Nov 18 18:24:03.161243 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 85e36ba2-dd4d-47c9-b794-f9104af3235f {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:24:03.182418 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:03.212477 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b4f794f8-b4ee-4972-81b8-be7f65e72a8d req-717c9c2b-6bb8-4fd5-bedc-18834a67d549 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1341891 Nov 18 18:24:03.221335 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Transition to ACTIVE for port object 85e36ba2-dd4d-47c9-b794-f9104af3235f will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:24:03.234306 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:03.300760 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dd704a8-39f6-4158-8a7c-3781095fadbe req-e6d2364a-ce93-4772-b2a2-0fa07d5b699c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:03.303523 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7dd704a8-39f6-4158-8a7c-3781095fadbe req-e6d2364a-ce93-4772-b2a2-0fa07d5b699c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 932 time: 0.1366076 Nov 18 18:24:03.415322 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Pushing event updated for resources: {'Port': ['ID=85e36ba2-dd4d-47c9-b794-f9104af3235f,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:03.497201 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec52005-eeda-44f5-8945-ab675f7d05bb req-dbd2f4ce-7bb6-4934-a044-fb62ac723910 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:03.498718 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eec52005-eeda-44f5-8945-ab675f7d05bb req-dbd2f4ce-7bb6-4934-a044-fb62ac723910 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1938660 Nov 18 18:24:03.505559 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7dd704a8-39f6-4158-8a7c-3781095fadbe req-4f13d1e4-63b3-4ac7-a030-345f7fd4cce6 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1942973 Nov 18 18:24:03.534422 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Attempting to bind port 85e36ba2-dd4d-47c9-b794-f9104af3235f on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:24:03.535087 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Attempting to bind port 85e36ba2-dd4d-47c9-b794-f9104af3235f by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:24:03.535495 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Attempting to bind port 85e36ba2-dd4d-47c9-b794-f9104af3235f on network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:24:03.551287 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Port 85e36ba2-dd4d-47c9-b794-f9104af3235f on network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:24:03.551503 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Attempting to bind port 85e36ba2-dd4d-47c9-b794-f9104af3235f on network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:24:03.568400 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 23, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:24:03.568930 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Checking segment: {'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:24:03.569465 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Bound using segment: {'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:24:03.569898 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Bound port: 85e36ba2-dd4d-47c9-b794-f9104af3235f, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0bd6ae3c-7404-429f-9807-6c61fe30f185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:24:03.570447 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:03.596479 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eec52005-eeda-44f5-8945-ab675f7d05bb req-a5677fcf-d6bd-49a5-98f2-c8a57cc71849 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0893376 Nov 18 18:24:03.667717 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] For port 85e36ba2-dd4d-47c9-b794-f9104af3235f, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:24:03.672120 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] For port 85e36ba2-dd4d-47c9-b794-f9104af3235f, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:24:03.676566 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:03.723915 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:03.724647 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:03.726648 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] 10.222.0.31 "PUT /v2.0/ports/85e36ba2-dd4d-47c9-b794-f9104af3235f HTTP/1.1" status: 200 len: 1094 time: 1.2935503 Nov 18 18:24:03.727215 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:24:03.733093 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fdce9317-4884-48ca-a8d0-c2f768323be4" -d '{"events": [{"name": "network-changed", "server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:24:03.773449 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a4c047-f947-4ec8-be74-c0d574155d6f service neutron] Pushing event updated for resources: {'Port': ['ID=85e36ba2-dd4d-47c9-b794-f9104af3235f,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:03.825424 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:24:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b68b1960-4bdb-4d97-a9a9-ef523b7ddace x-openstack-request-id: req-b68b1960-4bdb-4d97-a9a9-ef523b7ddace {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:24:03.825734 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:24:03.825990 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-b68b1960-4bdb-4d97-a9a9-ef523b7ddace {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:24:03.827154 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'status': 'completed', 'code': 200} Nov 18 18:24:03.843419 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-87a21b3e-1430-4969-a249-a95e51663c91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:03.845287 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-87a21b3e-1430-4969-a249-a95e51663c91 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=029e580af1e3498aa00c86f5ce660a80&device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 1097 time: 0.0635633 Nov 18 18:24:03.901632 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-033e3002-2bf3-4614-bddd-b1e24de6980a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f HTTP/1.1" status: 200 len: 217 time: 0.0392401 Nov 18 18:24:04.009216 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-698e128e-6d8f-4185-9902-1a9c53add8cf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:04.226500 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-1db1dcf6-d3bc-4f7c-9bfa-6fccf86bc024 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:04.227998 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-1db1dcf6-d3bc-4f7c-9bfa-6fccf86bc024 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cac1be0a-3676-49bd-8292-3623cc0fc8b1 HTTP/1.1" status: 200 len: 846 time: 0.3127713 Nov 18 18:24:04.249050 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-920e2675-a1c1-443e-89ec-0cbe275ff3ad req-d71ba47b-1893-4276-baa5-cd459e1a7c5a tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:04.250576 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-920e2675-a1c1-443e-89ec-0cbe275ff3ad req-d71ba47b-1893-4276-baa5-cd459e1a7c5a tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0922210 Nov 18 18:24:04.290683 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d981073-04ac-4415-a867-f5bf16389fe0 req-d637fec0-384e-4af7-b435-c267a7fb46da tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:04.292330 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7d981073-04ac-4415-a867-f5bf16389fe0 req-d637fec0-384e-4af7-b435-c267a7fb46da tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1351504 Nov 18 18:24:04.358865 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-62595191-b78f-4dfe-8515-0626fcbf0503 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:04.360395 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-62595191-b78f-4dfe-8515-0626fcbf0503 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1087639 Nov 18 18:24:04.373795 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7d981073-04ac-4415-a867-f5bf16389fe0 req-4727cefb-417b-4277-ae92-715312978587 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0707264 Nov 18 18:24:04.399222 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-920e2675-a1c1-443e-89ec-0cbe275ff3ad req-8ac7eb27-6c58-49ee-8cdf-a102882ce724 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1385036 Nov 18 18:24:04.512756 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-67080dc2-c35a-4692-8c50-4363b1812bc3 service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1354642 Nov 18 18:24:04.526059 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be190afd-ee81-4eb2-ad3d-e351239b677a req-8e245368-9f51-4928-80fb-7b3dd19c2530 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:04.527546 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-be190afd-ee81-4eb2-ad3d-e351239b677a req-8e245368-9f51-4928-80fb-7b3dd19c2530 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0662415 Nov 18 18:24:04.664449 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-be190afd-ee81-4eb2-ad3d-e351239b677a req-214f40b3-2f9c-40e2-8fef-079befb683f6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1286051 Nov 18 18:24:04.693925 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d794af9a-7c74-453e-9cb9-1d15281a459a req-ca5f8e94-8d03-4b03-8cd3-163d4019f561 service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1653340 Nov 18 18:24:04.714732 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f000c391-2bae-4a98-9b30-60a4e80482f0 req-f37e253c-11ec-4550-9963-70268e808931 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:04.719875 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f000c391-2bae-4a98-9b30-60a4e80482f0 req-f37e253c-11ec-4550-9963-70268e808931 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.1416028 Nov 18 18:24:04.824935 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f000c391-2bae-4a98-9b30-60a4e80482f0 req-4d35e50f-4927-445d-b72f-9ff5668b4720 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1018088 Nov 18 18:24:04.842467 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cee22a0-8601-401f-a85d-bc08b9c80ff8 req-f4452778-fcfa-4b16-864c-c4a7769b51ab tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:04.844135 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2cee22a0-8601-401f-a85d-bc08b9c80ff8 req-f4452778-fcfa-4b16-864c-c4a7769b51ab tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1066163 Nov 18 18:24:04.852862 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdce9317-4884-48ca-a8d0-c2f768323be4 req-fbee6ca0-7490-480b-8660-f08f60d02de9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:04.854401 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fdce9317-4884-48ca-a8d0-c2f768323be4 req-fbee6ca0-7490-480b-8660-f08f60d02de9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=029e580af1e3498aa00c86f5ce660a80&device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 1097 time: 0.0886204 Nov 18 18:24:04.953628 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2cee22a0-8601-401f-a85d-bc08b9c80ff8 req-3e1f44e3-e404-4092-b2e5-ba0bd0ef9bdf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0981591 Nov 18 18:24:04.991090 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdce9317-4884-48ca-a8d0-c2f768323be4 req-35441da2-fcf3-4b65-a052-643dab39262c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:04.992384 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fdce9317-4884-48ca-a8d0-c2f768323be4 req-35441da2-fcf3-4b65-a052-643dab39262c service neutron] 10.222.0.31 "GET /v2.0/networks?id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a HTTP/1.1" status: 200 len: 909 time: 0.1228604 Nov 18 18:24:05.082596 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fdce9317-4884-48ca-a8d0-c2f768323be4 req-e8a61c48-36a5-4c44-bd88-39ad60cd3a9e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f HTTP/1.1" status: 200 len: 217 time: 0.0437703 Nov 18 18:24:05.159149 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001d487a-da07-4ad3-ab52-598b806456f8 req-53bf50fc-5d89-422c-b7c9-6dfe7766e731 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:05.160675 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-001d487a-da07-4ad3-ab52-598b806456f8 req-53bf50fc-5d89-422c-b7c9-6dfe7766e731 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 946 time: 0.0873051 Nov 18 18:24:05.165812 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdce9317-4884-48ca-a8d0-c2f768323be4 req-858b1c9e-a787-4320-bde4-e9bb10295809 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:05.167346 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fdce9317-4884-48ca-a8d0-c2f768323be4 req-858b1c9e-a787-4320-bde4-e9bb10295809 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cac1be0a-3676-49bd-8292-3623cc0fc8b1 HTTP/1.1" status: 200 len: 846 time: 0.0645075 Nov 18 18:24:05.233662 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-001d487a-da07-4ad3-ab52-598b806456f8 req-52367931-f23e-49f4-b819-ed4e37596db3 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652771 Nov 18 18:24:05.246285 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdce9317-4884-48ca-a8d0-c2f768323be4 req-b800a1b2-c8b8-40b9-81ba-b874b748dee3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:05.247863 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fdce9317-4884-48ca-a8d0-c2f768323be4 req-b800a1b2-c8b8-40b9-81ba-b874b748dee3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0660374 Nov 18 18:24:05.351463 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fdce9317-4884-48ca-a8d0-c2f768323be4 req-42825c83-4462-448e-9c3b-6354db521254 service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879056 Nov 18 18:24:05.452914 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fdce9317-4884-48ca-a8d0-c2f768323be4 req-a68cb2d5-41bd-47b0-8a50-fb3db1c02ce8 service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0920177 Nov 18 18:24:05.548753 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e45e1bf2-f26a-4981-babf-a91692ec95f9 req-d7f757cc-e288-4fd3-bf06-e95b3927bc61 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:05.550551 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e45e1bf2-f26a-4981-babf-a91692ec95f9 req-d7f757cc-e288-4fd3-bf06-e95b3927bc61 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0817320 Nov 18 18:24:05.565675 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76120545-1a37-429d-9590-bc0e9ace9767 req-ba7b9231-5700-425f-b9f5-b9b2d9a0df6c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:05.567294 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-76120545-1a37-429d-9590-bc0e9ace9767 req-ba7b9231-5700-425f-b9f5-b9b2d9a0df6c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0728545 Nov 18 18:24:05.653188 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-76120545-1a37-429d-9590-bc0e9ace9767 req-84e5ef0e-e0b3-4e3f-979a-dc3ee83107db tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786688 Nov 18 18:24:05.657687 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e45e1bf2-f26a-4981-babf-a91692ec95f9 req-b0ee5485-4364-4db9-b68c-804f78e10ce1 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1000800 Nov 18 18:24:05.792936 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5570f2e6-8bc2-4b1d-81bb-4d7766283714 req-7223cb47-b143-41e9-9f7f-fb74e1885f8b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:05.794501 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5570f2e6-8bc2-4b1d-81bb-4d7766283714 req-7223cb47-b143-41e9-9f7f-fb74e1885f8b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0559616 Nov 18 18:24:05.843520 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5570f2e6-8bc2-4b1d-81bb-4d7766283714 req-4c108d67-5e30-4c43-a77e-3b548ffb1737 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428154 Nov 18 18:24:05.948645 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a2ce4fc-c249-4ccd-a268-4a7ee1392262 req-3cf1b39b-a912-450b-b89e-8216fe452443 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:05.950537 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a2ce4fc-c249-4ccd-a268-4a7ee1392262 req-3cf1b39b-a912-450b-b89e-8216fe452443 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.0515337 Nov 18 18:24:06.005661 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a2ce4fc-c249-4ccd-a268-4a7ee1392262 req-39be4010-1f03-4cad-89ac-30c3c04ec89b tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487931 Nov 18 18:24:06.081184 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14794cb7-86c6-4020-8f94-464ae53c70fd req-16eb407d-0799-4494-9517-5131325f0124 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:06.082798 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-14794cb7-86c6-4020-8f94-464ae53c70fd req-16eb407d-0799-4494-9517-5131325f0124 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0507803 Nov 18 18:24:06.151662 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-14794cb7-86c6-4020-8f94-464ae53c70fd req-5584ab0c-1572-4d63-8a51-3b57d882e3c1 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0608950 Nov 18 18:24:06.373080 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c33ba9-6d68-4d95-83ab-b21e4e56a8a5 req-1ebe79bd-36ad-4490-b977-d8640d8cd5c1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:06.374698 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b8c33ba9-6d68-4d95-83ab-b21e4e56a8a5 req-1ebe79bd-36ad-4490-b977-d8640d8cd5c1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 946 time: 0.0522161 Nov 18 18:24:06.444968 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b8c33ba9-6d68-4d95-83ab-b21e4e56a8a5 req-9070e59d-7fb6-40d5-aee1-7130fef0a489 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602875 Nov 18 18:24:06.451419 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-c86ea4fe-f6c4-4261-8196-d07df9686350 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:06.828811 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39408c7e-e192-4d02-bb23-d784c47e4002 req-54e07d1c-9ee8-474f-a4b0-8a47adb53ed8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:06.830694 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-39408c7e-e192-4d02-bb23-d784c47e4002 req-54e07d1c-9ee8-474f-a4b0-8a47adb53ed8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1014705 Nov 18 18:24:06.847119 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e92b5cd-4114-482a-a5ec-36757f057069 req-fe1e579e-7561-4e65-8662-b18663b93ee5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:06.849812 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e92b5cd-4114-482a-a5ec-36757f057069 req-fe1e579e-7561-4e65-8662-b18663b93ee5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1071217 Nov 18 18:24:06.945794 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-39408c7e-e192-4d02-bb23-d784c47e4002 req-694e71ba-fa5d-43ee-872c-748b672fd30f tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0948334 Nov 18 18:24:06.951106 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e92b5cd-4114-482a-a5ec-36757f057069 req-7baad296-b09b-440d-9edf-f76ca6007bd3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0911067 Nov 18 18:24:07.076777 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2a1c00d-0c71-4983-9af5-cb62a55aabeb req-59eea275-ed14-4761-b0ca-27fcc52c5352 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:07.078954 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d2a1c00d-0c71-4983-9af5-cb62a55aabeb req-59eea275-ed14-4761-b0ca-27fcc52c5352 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0717735 Nov 18 18:24:07.162768 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7eb6d0-f7bc-49ac-b83e-44bfa8e4b5c4 req-5661b8b1-7337-4402-aba0-dd105e364772 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:07.164498 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-df7eb6d0-f7bc-49ac-b83e-44bfa8e4b5c4 req-5661b8b1-7337-4402-aba0-dd105e364772 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.0779276 Nov 18 18:24:07.168187 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d2a1c00d-0c71-4983-9af5-cb62a55aabeb req-41f64890-c75b-4361-9da8-e3a17b38754b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0833304 Nov 18 18:24:07.233391 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-df7eb6d0-f7bc-49ac-b83e-44bfa8e4b5c4 req-51b0be9a-a54b-4b6f-8532-ee6da232085b tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0632744 Nov 18 18:24:07.285269 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2611d39c-e02a-4071-9c1d-a6d7b1fe5d14 req-b5c0a76a-85aa-4667-9586-57636a46a9ac tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:07.286998 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2611d39c-e02a-4071-9c1d-a6d7b1fe5d14 req-b5c0a76a-85aa-4667-9586-57636a46a9ac tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0525401 Nov 18 18:24:07.334253 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2611d39c-e02a-4071-9c1d-a6d7b1fe5d14 req-2e794f37-716e-447a-8046-39a936750fe8 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409584 Nov 18 18:24:07.580079 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22891b99-0c42-41ff-8847-2877e7958f05 req-080e6c52-e6e0-466f-a56c-68bb2edf122d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:07.582023 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22891b99-0c42-41ff-8847-2877e7958f05 req-080e6c52-e6e0-466f-a56c-68bb2edf122d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 946 time: 0.0666683 Nov 18 18:24:07.640459 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22891b99-0c42-41ff-8847-2877e7958f05 req-6500bda4-0ebc-4a1a-a2a2-66254061b1da tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516567 Nov 18 18:24:07.698201 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:07.723518 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07136ecf-1add-4e40-a5f8-55e6c5fc4ead req-7bd27cf3-52f6-4729-815c-d43a0760877d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:07.725688 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-07136ecf-1add-4e40-a5f8-55e6c5fc4ead req-7bd27cf3-52f6-4729-815c-d43a0760877d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 946 time: 0.0548973 Nov 18 18:24:07.824612 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-07136ecf-1add-4e40-a5f8-55e6c5fc4ead req-60914464-abb4-4981-8d82-958560097d09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Deleting port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:24:07.824942 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-07136ecf-1add-4e40-a5f8-55e6c5fc4ead req-60914464-abb4-4981-8d82-958560097d09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:07.915484 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-07136ecf-1add-4e40-a5f8-55e6c5fc4ead req-60914464-abb4-4981-8d82-958560097d09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] For port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:24:07.916210 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-07136ecf-1add-4e40-a5f8-55e6c5fc4ead req-60914464-abb4-4981-8d82-958560097d09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:07.927789 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-07136ecf-1add-4e40-a5f8-55e6c5fc4ead req-60914464-abb4-4981-8d82-958560097d09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Calling delete_port for 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:24:08.121993 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-07136ecf-1add-4e40-a5f8-55e6c5fc4ead req-60914464-abb4-4981-8d82-958560097d09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:08.136864 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['f3483de4-481b-47ac-8d51-f8457fd0bb85', '1b418eab-96c7-4da9-ba41-6e91026f7285', '6c7a2d7a-25d2-4642-b407-868695446a27', '7f5eeb8c-4f5d-4aff-8212-8c2f004ba255'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:24:08.173563 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f335645f-ae5b-421c-9476-74f30284500b req-48b80197-a648-406f-9800-0e6784f634d4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:08.175778 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f335645f-ae5b-421c-9476-74f30284500b req-48b80197-a648-406f-9800-0e6784f634d4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1336787 Nov 18 18:24:08.187166 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60914464-abb4-4981-8d82-958560097d09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Pushing event deleted for resources: {'Port': ['ID=7f5eeb8c-4f5d-4aff-8212-8c2f004ba255,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:08.206667 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-541b1db5-ad1f-4d6b-9867-8904d932bcc3 req-24233818-3d25-44b6-9c59-bd7b788a2ff9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:08.215675 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-541b1db5-ad1f-4d6b-9867-8904d932bcc3 req-24233818-3d25-44b6-9c59-bd7b788a2ff9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1597011 Nov 18 18:24:08.279535 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-07136ecf-1add-4e40-a5f8-55e6c5fc4ead req-60914464-abb4-4981-8d82-958560097d09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] No DVR routers for this DVR port 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:24:08.283762 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-07136ecf-1add-4e40-a5f8-55e6c5fc4ead req-60914464-abb4-4981-8d82-958560097d09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:08.287083 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-07136ecf-1add-4e40-a5f8-55e6c5fc4ead req-60914464-abb4-4981-8d82-958560097d09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "DELETE /v2.0/ports/7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 HTTP/1.1" status: 204 len: 173 time: 0.5550699 Nov 18 18:24:08.290224 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8694df99-13ee-45f4-b82d-23add3f16c40', 'name': 'network-vif-deleted', 'tag': '7f5eeb8c-4f5d-4aff-8212-8c2f004ba255'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:24:08.295309 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e1ff03e-3f57-44b6-8e35-0beee8027a0f" -d '{"events": [{"server_uuid": "8694df99-13ee-45f4-b82d-23add3f16c40", "name": "network-vif-deleted", "tag": "7f5eeb8c-4f5d-4aff-8212-8c2f004ba255"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:24:08.351431 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f335645f-ae5b-421c-9476-74f30284500b req-17592f01-c20e-4af0-aa06-9cb75d24ad11 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1605792 Nov 18 18:24:08.378580 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-541b1db5-ad1f-4d6b-9867-8904d932bcc3 req-6eecd2e0-3f98-4dc6-b7d4-a55dfa7ed1ce tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1620250 Nov 18 18:24:08.559340 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b79590ca-837c-4ea2-9e7f-7fb42b3e5fcb req-83bb46f9-8da5-49fb-a46a-f9ccaf87671e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:08.567173 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b79590ca-837c-4ea2-9e7f-7fb42b3e5fcb req-83bb46f9-8da5-49fb-a46a-f9ccaf87671e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1089761 Nov 18 18:24:08.599783 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51804321-4d32-4558-be03-2d88e2f5333e req-ce24a8de-ffd6-46ab-88ff-449667b3e03f tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:08.601471 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-51804321-4d32-4558-be03-2d88e2f5333e req-ce24a8de-ffd6-46ab-88ff-449667b3e03f tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.1068244 Nov 18 18:24:08.652496 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b79590ca-837c-4ea2-9e7f-7fb42b3e5fcb req-e7a9baaf-ef26-4aa7-84f5-d14673be0ee5 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0843017 Nov 18 18:24:08.701408 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-51804321-4d32-4558-be03-2d88e2f5333e req-653317ea-8cd7-4534-8a5d-478c640b8d2f tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0895257 Nov 18 18:24:08.713673 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:24:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f124480b-3934-4500-983b-eb9150151959 x-openstack-request-id: req-f124480b-3934-4500-983b-eb9150151959 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:24:08.714743 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8694df99-13ee-45f4-b82d-23add3f16c40", "name": "network-vif-deleted", "tag": "7f5eeb8c-4f5d-4aff-8212-8c2f004ba255", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:24:08.715508 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-f124480b-3934-4500-983b-eb9150151959 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:24:08.716224 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8694df99-13ee-45f4-b82d-23add3f16c40', 'name': 'network-vif-deleted', 'tag': '7f5eeb8c-4f5d-4aff-8212-8c2f004ba255', 'status': 'completed', 'code': 200} Nov 18 18:24:08.842439 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bae5ab96-3d40-40e2-8157-f84172e3e9e7 req-c6d02a7c-5104-4ce5-9134-9a5a353da928 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=8694df99-13ee-45f4-b82d-23add3f16c40 HTTP/1.1" status: 200 len: 210 time: 0.0311193 Nov 18 18:24:08.863363 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-223a7890-3537-4ea6-8f98-73fb9aa8e954 req-1be707e0-a467-4fcc-a0fa-c9e9a80c9ea1 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:08.865105 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-223a7890-3537-4ea6-8f98-73fb9aa8e954 req-1be707e0-a467-4fcc-a0fa-c9e9a80c9ea1 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0853903 Nov 18 18:24:08.928488 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-223a7890-3537-4ea6-8f98-73fb9aa8e954 req-998e7b8c-207b-40f2-937d-811666aad223 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553000 Nov 18 18:24:09.040737 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:09.514326 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-162a812d-bdb1-490c-a733-2c986815f862 req-d46d48e6-742a-4036-8a71-3180c9d8ded0 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:09.515836 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-162a812d-bdb1-490c-a733-2c986815f862 req-d46d48e6-742a-4036-8a71-3180c9d8ded0 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0887504 Nov 18 18:24:09.523419 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de900d4b-3ba6-4da5-aa31-49c7368762de req-424385eb-57d5-46cb-bf93-1beb6aa2ad5f tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:09.524854 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-de900d4b-3ba6-4da5-aa31-49c7368762de req-424385eb-57d5-46cb-bf93-1beb6aa2ad5f tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0694726 Nov 18 18:24:09.598743 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-162a812d-bdb1-490c-a733-2c986815f862 req-6867bb4e-14d0-40df-93d0-42b11a7e7e29 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0729342 Nov 18 18:24:09.602338 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-de900d4b-3ba6-4da5-aa31-49c7368762de req-88f4c179-9bc2-4e26-8d9e-85457234ac29 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708539 Nov 18 18:24:09.785505 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c00e2881-e135-42c3-aaab-e732c5a346a5 req-b48bc59f-e521-46ab-8960-a688d90dbc08 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:09.786978 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c00e2881-e135-42c3-aaab-e732c5a346a5 req-b48bc59f-e521-46ab-8960-a688d90dbc08 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0605841 Nov 18 18:24:10.071602 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1e7558-5b7b-49a7-828b-0b677d02c014 req-81d92c87-e3e8-4e8e-a301-5024250c012d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:10.073208 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5c1e7558-5b7b-49a7-828b-0b677d02c014 req-81d92c87-e3e8-4e8e-a301-5024250c012d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.2964444 Nov 18 18:24:10.078054 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c00e2881-e135-42c3-aaab-e732c5a346a5 req-3b2f1039-a604-4677-be5c-9cce7c02bd89 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2838054 Nov 18 18:24:10.126294 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5c1e7558-5b7b-49a7-828b-0b677d02c014 req-5cb71538-b67f-4d85-93d9-85abfd75ec40 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458539 Nov 18 18:24:10.185415 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:10.256461 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad0fcb2-6095-48ab-b6c5-8f7018fb3017 req-0b8a672e-db6b-4045-ae14-9894007dd1f1 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:10.259976 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dad0fcb2-6095-48ab-b6c5-8f7018fb3017 req-0b8a672e-db6b-4045-ae14-9894007dd1f1 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0570602 Nov 18 18:24:10.307401 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dad0fcb2-6095-48ab-b6c5-8f7018fb3017 req-74338ae5-d953-4036-b25b-1a350174632d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431926 Nov 18 18:24:10.789595 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e23ef53-a160-4115-8fb9-57457a9cfe93 req-326408f4-6a54-4a6c-933c-c60f84466f45 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:10.791333 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7e23ef53-a160-4115-8fb9-57457a9cfe93 req-326408f4-6a54-4a6c-933c-c60f84466f45 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0820365 Nov 18 18:24:10.811859 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8897fbcf-5193-4ef8-8a8b-adde72cba5e9 req-1a865334-9e69-42ae-acc4-fe07bd286df3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:10.813406 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8897fbcf-5193-4ef8-8a8b-adde72cba5e9 req-1a865334-9e69-42ae-acc4-fe07bd286df3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0770614 Nov 18 18:24:10.890597 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7e23ef53-a160-4115-8fb9-57457a9cfe93 req-a67d2f9d-3349-4eb2-91d4-d6a5f38017be tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0915475 Nov 18 18:24:10.913843 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8897fbcf-5193-4ef8-8a8b-adde72cba5e9 req-9fc139f2-2024-4207-b247-ac03170f1104 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0879316 Nov 18 18:24:11.203637 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f34d28d2-89aa-481a-ab35-97903de5631b req-04f59fb1-46a3-4ac9-ba6b-e060eef7c077 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:11.205391 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f34d28d2-89aa-481a-ab35-97903de5631b req-04f59fb1-46a3-4ac9-ba6b-e060eef7c077 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0571225 Nov 18 18:24:11.281827 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f34d28d2-89aa-481a-ab35-97903de5631b req-3fdb54cb-124e-40fb-bb9a-bb8b64d010f2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0668652 Nov 18 18:24:11.290222 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddb4f3f-5ab2-4d86-a264-801a71ec00d1 req-3df2a076-2c7a-4c1b-8763-1f85d31430c4 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:11.291717 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dddb4f3f-5ab2-4d86-a264-801a71ec00d1 req-3df2a076-2c7a-4c1b-8763-1f85d31430c4 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.0854180 Nov 18 18:24:11.354040 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:24:11.364541 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dddb4f3f-5ab2-4d86-a264-801a71ec00d1 req-24f5b6af-d6a4-406c-839c-a9677ec261ed tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0666392 Nov 18 18:24:11.377848 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:24:11.378637 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 7f5eeb8c-4f5d-4aff-8212-8c2f004ba255 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:24:11.503783 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69fd7384-7c59-4376-a501-eaa78b161fda req-e4b77301-2cc4-404d-8e66-a6007ea695cd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:11.505530 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-69fd7384-7c59-4376-a501-eaa78b161fda req-e4b77301-2cc4-404d-8e66-a6007ea695cd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0634644 Nov 18 18:24:11.595634 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df0a3da9-7972-4022-867d-08c391d30f24 req-ae3b225f-e51a-4b56-8ff7-f73f461b16a2 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:11.597415 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-df0a3da9-7972-4022-867d-08c391d30f24 req-ae3b225f-e51a-4b56-8ff7-f73f461b16a2 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 945 time: 0.0900393 Nov 18 18:24:11.601860 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-69fd7384-7c59-4376-a501-eaa78b161fda req-57fcddb2-d455-4272-8b62-fdc6d9fb0890 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0854878 Nov 18 18:24:11.648373 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-df0a3da9-7972-4022-867d-08c391d30f24 req-34bfccfb-1c19-4ad1-832f-774a3c55e361 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440547 Nov 18 18:24:12.042490 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3daf83d-d89c-4304-a7c5-5077cd53ef39 req-723b67a6-819b-47f1-98d3-3ee641d9d71f tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:12.044189 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e3daf83d-d89c-4304-a7c5-5077cd53ef39 req-723b67a6-819b-47f1-98d3-3ee641d9d71f tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0812006 Nov 18 18:24:12.066934 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55835a52-e540-4675-ba28-cb141955c6d7 req-80bfc2d6-a3d0-4e76-95fe-3535ece0e619 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:12.068426 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-55835a52-e540-4675-ba28-cb141955c6d7 req-80bfc2d6-a3d0-4e76-95fe-3535ece0e619 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0735469 Nov 18 18:24:12.132588 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e3daf83d-d89c-4304-a7c5-5077cd53ef39 req-adafba44-f257-4587-8a67-3bf22e0b796e tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798757 Nov 18 18:24:12.153857 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-55835a52-e540-4675-ba28-cb141955c6d7 req-cef8b513-87cf-466e-bf0f-50d241763ac2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0788281 Nov 18 18:24:12.421341 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59e78bf4-c36a-46c0-974c-f65b9d5cd71e req-562d38fe-773a-4947-be01-22eaa4fc755c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:12.422864 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-59e78bf4-c36a-46c0-974c-f65b9d5cd71e req-562d38fe-773a-4947-be01-22eaa4fc755c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0575695 Nov 18 18:24:12.525409 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-59e78bf4-c36a-46c0-974c-f65b9d5cd71e req-975b79bc-29dd-4f79-85d6-df661b5fda42 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0781980 Nov 18 18:24:12.536603 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb50e07d-9f8a-40af-80d0-2ca2d452ef33 req-46369a6b-ed0d-4fe0-830c-8505c57ad50a tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:12.538173 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fb50e07d-9f8a-40af-80d0-2ca2d452ef33 req-46369a6b-ed0d-4fe0-830c-8505c57ad50a tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.0849183 Nov 18 18:24:12.603248 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fb50e07d-9f8a-40af-80d0-2ca2d452ef33 req-bf2597cc-358c-44c4-8345-7c9d9f3d604f tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470278 Nov 18 18:24:12.780194 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbca832-b5e1-4eaf-ad73-4295a67b603c req-ec8bb0d3-412e-4a10-a542-8ffd355b587f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:12.781720 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ecbca832-b5e1-4eaf-ad73-4295a67b603c req-ec8bb0d3-412e-4a10-a542-8ffd355b587f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0969756 Nov 18 18:24:12.804191 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da0f3ff-35c1-4e6a-ac3c-a978c135d7d2 req-eac48c09-97d4-43df-9047-ccdf8f958be4 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:12.805650 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9da0f3ff-35c1-4e6a-ac3c-a978c135d7d2 req-eac48c09-97d4-43df-9047-ccdf8f958be4 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 945 time: 0.0758402 Nov 18 18:24:12.873552 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ecbca832-b5e1-4eaf-ad73-4295a67b603c req-77d32241-2f39-493e-b08d-2d0108552c22 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834789 Nov 18 18:24:12.877001 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9da0f3ff-35c1-4e6a-ac3c-a978c135d7d2 req-b1a0bdc8-0890-4dfa-9745-400ff8a0bfe4 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632186 Nov 18 18:24:13.301340 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50297eba-f4bd-4f9d-9fcf-4bd0351b21c4 req-c2577e5f-277e-4b27-9be1-066f5cb53148 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:13.303063 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50297eba-f4bd-4f9d-9fcf-4bd0351b21c4 req-c2577e5f-277e-4b27-9be1-066f5cb53148 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0806887 Nov 18 18:24:13.325298 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84adc1bb-0923-444b-bea3-b7e0026f141b req-403d84e4-b3c5-4489-98d6-a7be9504fcab tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:13.326745 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-84adc1bb-0923-444b-bea3-b7e0026f141b req-403d84e4-b3c5-4489-98d6-a7be9504fcab tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0765624 Nov 18 18:24:13.367782 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 85e36ba2-dd4d-47c9-b794-f9104af3235f details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:24:13.387281 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50297eba-f4bd-4f9d-9fcf-4bd0351b21c4 req-fa2b7ebf-0f77-4dde-9a93-fc446a4c9fd0 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765283 Nov 18 18:24:13.411390 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-84adc1bb-0923-444b-bea3-b7e0026f141b req-830f2846-494e-4feb-b64c-79393ccfb20d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0684369 Nov 18 18:24:13.495623 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 85e36ba2-dd4d-47c9-b794-f9104af3235f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:24:13.637960 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'port_id': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'mac_address': 'fa:16:3e:8d:d3:4a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1345, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:24:13.650986 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cd823b-bd70-44e5-9c98-c34e8544278b req-9609b04f-e290-4600-9b23-81dc0b2fa9b3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:13.658123 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-93cd823b-bd70-44e5-9c98-c34e8544278b req-9609b04f-e290-4600-9b23-81dc0b2fa9b3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0623763 Nov 18 18:24:13.685778 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:13.701632 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 85e36ba2-dd4d-47c9-b794-f9104af3235f {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:24:13.723819 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 85e36ba2-dd4d-47c9-b794-f9104af3235f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:24:13.728655 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:13.750646 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-93cd823b-bd70-44e5-9c98-c34e8544278b req-e31f7d2a-f71f-4988-b77f-75b296e7f32f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0915785 Nov 18 18:24:13.768328 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-844caec5-538b-49e6-b71f-2ba60df11bdd req-e3f363e0-4190-4605-9275-4632216ccdda tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:13.770155 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-844caec5-538b-49e6-b71f-2ba60df11bdd req-e3f363e0-4190-4605-9275-4632216ccdda tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.0796306 Nov 18 18:24:13.794103 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=85e36ba2-dd4d-47c9-b794-f9104af3235f,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:13.833968 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-844caec5-538b-49e6-b71f-2ba60df11bdd req-2d624d77-0c34-46c5-b091-e458708358e1 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0553837 Nov 18 18:24:14.026882 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7681132a-869b-4b1b-a84c-4de713d5a33d req-de16653e-e35b-4d45-a033-316e8d61252f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:14.029056 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7681132a-869b-4b1b-a84c-4de713d5a33d req-de16653e-e35b-4d45-a033-316e8d61252f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0796707 Nov 18 18:24:14.038456 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e82cb62-e6c9-4dbc-ad07-0ef16a6532db req-d591a0f3-0265-4afd-ac5a-8505c2e5cbde tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:14.040057 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2e82cb62-e6c9-4dbc-ad07-0ef16a6532db req-d591a0f3-0265-4afd-ac5a-8505c2e5cbde tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 945 time: 0.0791953 Nov 18 18:24:14.117368 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7681132a-869b-4b1b-a84c-4de713d5a33d req-04801a5c-dc8b-4d5e-8069-a2a4bad5283d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0762639 Nov 18 18:24:14.120652 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2e82cb62-e6c9-4dbc-ad07-0ef16a6532db req-0a3c9a1b-c887-46e0-b50e-696c814edb4b tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737646 Nov 18 18:24:14.254635 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['85e36ba2-dd4d-47c9-b794-f9104af3235f'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:24:14.283583 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8c19abc-aafd-4bb2-80f3-e20fd6be42e9 req-ccd28dea-9758-48f7-9d56-419babe00eb7 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:14.286584 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e8c19abc-aafd-4bb2-80f3-e20fd6be42e9 req-ccd28dea-9758-48f7-9d56-419babe00eb7 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 945 time: 0.0710757 Nov 18 18:24:14.393140 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-e8c19abc-aafd-4bb2-80f3-e20fd6be42e9 req-12ef4bab-66b9-4915-8530-050c4fcd4b6d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Deleting port 6c7a2d7a-25d2-4642-b407-868695446a27 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:24:14.393981 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-e8c19abc-aafd-4bb2-80f3-e20fd6be42e9 req-12ef4bab-66b9-4915-8530-050c4fcd4b6d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:14.538519 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-e8c19abc-aafd-4bb2-80f3-e20fd6be42e9 req-12ef4bab-66b9-4915-8530-050c4fcd4b6d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] For port 6c7a2d7a-25d2-4642-b407-868695446a27, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=6c7a2d7a-25d2-4642-b407-868695446a27,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:24:14.538805 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-e8c19abc-aafd-4bb2-80f3-e20fd6be42e9 req-12ef4bab-66b9-4915-8530-050c4fcd4b6d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:14.572271 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-e8c19abc-aafd-4bb2-80f3-e20fd6be42e9 req-12ef4bab-66b9-4915-8530-050c4fcd4b6d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Calling delete_port for 6c7a2d7a-25d2-4642-b407-868695446a27 owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:24:14.637891 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b26ba95-d21c-4c76-8351-fbe4bdafa1e4 req-79a3495d-e6bc-46bd-818f-533107ca982c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:14.639394 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5b26ba95-d21c-4c76-8351-fbe4bdafa1e4 req-79a3495d-e6bc-46bd-818f-533107ca982c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1427476 Nov 18 18:24:14.654053 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb5d0555-c746-4505-bece-ae606517d199 req-a2423a7d-3ad2-41e2-9241-97ad4c70c85d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:14.655530 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fb5d0555-c746-4505-bece-ae606517d199 req-a2423a7d-3ad2-41e2-9241-97ad4c70c85d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1455524 Nov 18 18:24:14.787560 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5b26ba95-d21c-4c76-8351-fbe4bdafa1e4 req-635cb468-657c-4165-95d5-8163a2fa80b2 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1293459 Nov 18 18:24:14.798009 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fb5d0555-c746-4505-bece-ae606517d199 req-971a906c-b1a9-40d2-90aa-048378c7e806 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1302879 Nov 18 18:24:14.829671 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-e8c19abc-aafd-4bb2-80f3-e20fd6be42e9 req-12ef4bab-66b9-4915-8530-050c4fcd4b6d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:14.863355 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ef4bab-66b9-4915-8530-050c4fcd4b6d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Pushing event deleted for resources: {'Port': ['ID=6c7a2d7a-25d2-4642-b407-868695446a27,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:14.934008 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-e8c19abc-aafd-4bb2-80f3-e20fd6be42e9 req-12ef4bab-66b9-4915-8530-050c4fcd4b6d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] No DVR routers for this DVR port 6c7a2d7a-25d2-4642-b407-868695446a27 on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:24:14.936988 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-e8c19abc-aafd-4bb2-80f3-e20fd6be42e9 req-12ef4bab-66b9-4915-8530-050c4fcd4b6d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:14.940351 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e8c19abc-aafd-4bb2-80f3-e20fd6be42e9 req-12ef4bab-66b9-4915-8530-050c4fcd4b6d tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "DELETE /v2.0/ports/6c7a2d7a-25d2-4642-b407-868695446a27 HTTP/1.1" status: 204 len: 173 time: 0.6458290 Nov 18 18:24:14.960245 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '93cf3d51-be0b-4879-8ba4-73c4b8762ca6', 'name': 'network-vif-deleted', 'tag': '6c7a2d7a-25d2-4642-b407-868695446a27'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:24:14.960975 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9b010a51-9b6d-4b24-ae9c-d82c22d3ec99" -d '{"events": [{"server_uuid": "93cf3d51-be0b-4879-8ba4-73c4b8762ca6", "name": "network-vif-deleted", "tag": "6c7a2d7a-25d2-4642-b407-868695446a27"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:24:15.038612 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7fba73b-5abc-4e09-b6d3-1c462518779e req-bb105b80-2c65-4d04-b617-b0c035ff79d5 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:15.040349 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a7fba73b-5abc-4e09-b6d3-1c462518779e req-bb105b80-2c65-4d04-b617-b0c035ff79d5 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1076529 Nov 18 18:24:15.049599 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-256782d3-330e-41ad-a334-a08d3de7f519 req-6236773e-7937-4e7e-b5b0-82d7b70011b6 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:15.051019 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-256782d3-330e-41ad-a334-a08d3de7f519 req-6236773e-7937-4e7e-b5b0-82d7b70011b6 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 945 time: 0.0868969 Nov 18 18:24:15.126878 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a7fba73b-5abc-4e09-b6d3-1c462518779e req-d419426c-f16b-47cc-a9cd-9601411ecd41 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0748732 Nov 18 18:24:15.132309 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-256782d3-330e-41ad-a334-a08d3de7f519 req-f7790470-1cda-4eba-834f-aa0fdeed6aa8 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0729206 Nov 18 18:24:15.189866 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:24:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b2d3977-b29e-4c15-a668-bac5b2ae565a x-openstack-request-id: req-6b2d3977-b29e-4c15-a668-bac5b2ae565a {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:24:15.190403 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "93cf3d51-be0b-4879-8ba4-73c4b8762ca6", "name": "network-vif-deleted", "tag": "6c7a2d7a-25d2-4642-b407-868695446a27", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:24:15.190887 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-6b2d3977-b29e-4c15-a668-bac5b2ae565a {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:24:15.192272 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '93cf3d51-be0b-4879-8ba4-73c4b8762ca6', 'name': 'network-vif-deleted', 'tag': '6c7a2d7a-25d2-4642-b407-868695446a27', 'status': 'completed', 'code': 200} Nov 18 18:24:15.294410 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5d1869e7-38d2-4a8e-b363-375aa54ee208 req-87ae5963-a79f-448f-ac4e-6a2c21acef1a tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=93cf3d51-be0b-4879-8ba4-73c4b8762ca6 HTTP/1.1" status: 200 len: 210 time: 0.0480442 Nov 18 18:24:15.326048 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5af6dcb-e31e-48bd-a6de-d1d3699c168a req-ca6c7d5e-cdb1-4207-8329-a833002f803a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:15.327579 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a5af6dcb-e31e-48bd-a6de-d1d3699c168a req-ca6c7d5e-cdb1-4207-8329-a833002f803a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0796168 Nov 18 18:24:15.379962 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a5af6dcb-e31e-48bd-a6de-d1d3699c168a req-1a69b5d8-7e8d-4d42-9924-062def7ee275 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458031 Nov 18 18:24:15.390016 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['f3483de4-481b-47ac-8d51-f8457fd0bb85', '1b418eab-96c7-4da9-ba41-6e91026f7285', '6c7a2d7a-25d2-4642-b407-868695446a27'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:24:15.956322 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e744c23-f6ec-4348-a344-599ade61d790 req-41a9a8cc-cd53-4176-addc-9245379d86aa tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:15.958025 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3e744c23-f6ec-4348-a344-599ade61d790 req-41a9a8cc-cd53-4176-addc-9245379d86aa tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0762012 Nov 18 18:24:15.967724 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f49ecf2a-a02f-42d7-8d22-4071712436c5 req-7362c314-9a13-4684-be63-f1cc9d00621c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:15.969315 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f49ecf2a-a02f-42d7-8d22-4071712436c5 req-7362c314-9a13-4684-be63-f1cc9d00621c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0887749 Nov 18 18:24:16.043695 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3e744c23-f6ec-4348-a344-599ade61d790 req-626c7a67-3538-46ad-bde6-c00c27f74641 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0733325 Nov 18 18:24:16.047112 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f49ecf2a-a02f-42d7-8d22-4071712436c5 req-c4d43b63-19c5-4bbd-9f51-c122674387af tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709519 Nov 18 18:24:16.300487 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90fcf32f-f792-489a-8945-e12095547ce6 req-153b542c-85ca-49e6-9332-648f4e6f9921 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:16.302360 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-90fcf32f-f792-489a-8945-e12095547ce6 req-153b542c-85ca-49e6-9332-648f4e6f9921 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 945 time: 0.0836217 Nov 18 18:24:16.317923 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13a940b9-a6ce-4b70-b54c-ba6de804b140 req-892d350d-d1d8-46e9-9468-722b050f950c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:16.319771 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-13a940b9-a6ce-4b70-b54c-ba6de804b140 req-892d350d-d1d8-46e9-9468-722b050f950c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0702963 Nov 18 18:24:16.390989 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-90fcf32f-f792-489a-8945-e12095547ce6 req-077a5a36-08b3-4b26-a7f2-113c7c1c693d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0812099 Nov 18 18:24:16.403372 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-13a940b9-a6ce-4b70-b54c-ba6de804b140 req-20f025e7-c259-45e3-8c14-aecb309c85e8 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0702462 Nov 18 18:24:16.531781 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0182739-aac5-49f5-8040-d1ec34efad60 req-bee37db0-c494-4a24-be41-e6522fecfc73 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:16.533358 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b0182739-aac5-49f5-8040-d1ec34efad60 req-bee37db0-c494-4a24-be41-e6522fecfc73 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0583932 Nov 18 18:24:16.607549 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b0182739-aac5-49f5-8040-d1ec34efad60 req-c06c449c-a071-4c57-b423-dc255b056e3f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671825 Nov 18 18:24:16.701659 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1bb10c1-19cb-43d3-a4d3-56d5ac2e7efd req-92c66e8a-90ce-4ae1-9890-3b122183dd48 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:16.703328 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1bb10c1-19cb-43d3-a4d3-56d5ac2e7efd req-92c66e8a-90ce-4ae1-9890-3b122183dd48 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 945 time: 0.0558112 Nov 18 18:24:16.758400 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b1bb10c1-19cb-43d3-a4d3-56d5ac2e7efd req-79e424eb-5694-4e27-a2bb-099dd447dfb9 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469723 Nov 18 18:24:17.195287 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80d3815c-bafd-43b7-957e-f9ee49c4ebf0 req-60b7fd9f-cf63-4c02-a1d8-5ad27fc237d6 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:17.196829 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-80d3815c-bafd-43b7-957e-f9ee49c4ebf0 req-60b7fd9f-cf63-4c02-a1d8-5ad27fc237d6 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0803230 Nov 18 18:24:17.205055 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d732174-8ad2-44d7-963a-2410fed4191e req-1e00f855-fe9d-4927-8d3d-e359a90fa11a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:17.206482 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1d732174-8ad2-44d7-963a-2410fed4191e req-1e00f855-fe9d-4927-8d3d-e359a90fa11a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0887256 Nov 18 18:24:17.282075 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-80d3815c-bafd-43b7-957e-f9ee49c4ebf0 req-9805586c-75a7-4553-bca3-b5dbbb0ecbad tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0745544 Nov 18 18:24:17.285109 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1d732174-8ad2-44d7-963a-2410fed4191e req-b3b42f3f-d7a9-4bbe-a977-91a554f68cd6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0715382 Nov 18 18:24:17.396474 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 85e36ba2-dd4d-47c9-b794-f9104af3235f up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:24:17.489310 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port 85e36ba2-dd4d-47c9-b794-f9104af3235f completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:24:17.495364 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 85e36ba2-dd4d-47c9-b794-f9104af3235f triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:24:17.497153 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:17.534647 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21190d6e-dd19-4da1-8aa4-42d65189c1e6 req-9e87efe2-dde7-4831-beb8-a60f748eb9cc tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:17.536139 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-21190d6e-dd19-4da1-8aa4-42d65189c1e6 req-9e87efe2-dde7-4831-beb8-a60f748eb9cc tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 945 time: 0.0608296 Nov 18 18:24:17.599064 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:17.622714 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4b4612-249f-42ae-b97b-b8bd5a9faa01 req-1c6d0662-9e18-4446-9283-7b25730bea07 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:17.627367 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:24:17.628949 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6e4b4612-249f-42ae-b97b-b8bd5a9faa01 req-1c6d0662-9e18-4446-9283-7b25730bea07 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0915396 Nov 18 18:24:17.630232 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b7fb5aa-cd98-4ff0-b85a-bef021e3992a" -d '{"events": [{"server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "name": "network-vif-plugged", "status": "completed", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:24:17.644472 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 85e36ba2-dd4d-47c9-b794-f9104af3235f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:24:17.650447 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:17.651450 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 6c7a2d7a-25d2-4642-b407-868695446a27 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:24:17.692739 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-21190d6e-dd19-4da1-8aa4-42d65189c1e6 req-9d8f2d3a-f96a-4b86-9be9-a10b2af67b5a tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1265423 Nov 18 18:24:17.695842 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: 6c7a2d7a-25d2-4642-b407-868695446a27 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:24:17.696461 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 6c7a2d7a-25d2-4642-b407-868695446a27 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:24:17.738778 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=85e36ba2-dd4d-47c9-b794-f9104af3235f,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:17.755901 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6e4b4612-249f-42ae-b97b-b8bd5a9faa01 req-e78d89c9-3409-48be-921d-9069882b641e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1244607 Nov 18 18:24:17.823088 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:24:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-30ed8a7e-8f2b-4ded-a555-e7d01559cdb9 x-openstack-request-id: req-30ed8a7e-8f2b-4ded-a555-e7d01559cdb9 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:24:17.823834 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "name": "network-vif-plugged", "status": "completed", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:24:17.824557 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-30ed8a7e-8f2b-4ded-a555-e7d01559cdb9 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:24:17.825036 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'code': 200} Nov 18 18:24:17.847735 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb1d33e6-2b9b-4772-92ee-6f410a3b3074 req-0e6d498d-b1ec-451f-bd4e-ec4a1c2949f2 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:17.849613 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fb1d33e6-2b9b-4772-92ee-6f410a3b3074 req-0e6d498d-b1ec-451f-bd4e-ec4a1c2949f2 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0587220 Nov 18 18:24:17.917536 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fb1d33e6-2b9b-4772-92ee-6f410a3b3074 req-6761550b-76e5-4296-9709-bf065cd98aef tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546207 Nov 18 18:24:17.954746 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfdea9aa-c739-4896-83e0-c5044dd888da req-587cf472-3ad2-4548-bab2-43a35a592fb2 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:17.956529 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dfdea9aa-c739-4896-83e0-c5044dd888da req-587cf472-3ad2-4548-bab2-43a35a592fb2 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 945 time: 0.0558743 Nov 18 18:24:18.033377 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dfdea9aa-c739-4896-83e0-c5044dd888da req-913ddd40-bbdb-4fc5-905a-379dbcfaafee tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662277 Nov 18 18:24:18.273706 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33a1eb9a-88de-4e1e-ab01-323dd4cbd983 req-372fb3bd-358f-46a9-b5c6-1f5d2dca3fa7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:18.275417 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-33a1eb9a-88de-4e1e-ab01-323dd4cbd983 req-372fb3bd-358f-46a9-b5c6-1f5d2dca3fa7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 1099 time: 0.0486896 Nov 18 18:24:18.343766 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-33a1eb9a-88de-4e1e-ab01-323dd4cbd983 req-80d72cec-6dd7-4d31-9732-4d8cd549748d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0576825 Nov 18 18:24:18.490691 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e67e209d-23dd-4f65-b671-85110c2ed985 req-ddcfa502-00c1-41bf-94bc-eb9d2e3d0de7 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:18.497578 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e67e209d-23dd-4f65-b671-85110c2ed985 req-ddcfa502-00c1-41bf-94bc-eb9d2e3d0de7 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1084363 Nov 18 18:24:18.508888 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756dfd67-1822-4750-be6f-ff06b0eb97de req-d4afdd51-ac29-4fb0-b0fd-a2f80d7331d8 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:18.510371 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-756dfd67-1822-4750-be6f-ff06b0eb97de req-d4afdd51-ac29-4fb0-b0fd-a2f80d7331d8 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1099665 Nov 18 18:24:18.582849 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e67e209d-23dd-4f65-b671-85110c2ed985 req-891b7d59-19e6-424c-94a6-b73b5a1bd2b8 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0844188 Nov 18 18:24:18.591240 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-756dfd67-1822-4750-be6f-ff06b0eb97de req-ed48927f-5049-4537-b10a-39af75dc9381 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0722461 Nov 18 18:24:18.705004 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5960eede-bda7-4ee6-aadf-1c2fa62cfb8b req-49a91e70-7ffd-402e-a1b8-4c6054b69ada tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:18.706768 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5960eede-bda7-4ee6-aadf-1c2fa62cfb8b req-49a91e70-7ffd-402e-a1b8-4c6054b69ada tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 945 time: 0.0886593 Nov 18 18:24:18.980141 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd78a0a2-42f5-49c8-a72c-1db590a049b3 req-200b96dc-58da-41a1-b9af-f95338368209 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:18.981664 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bd78a0a2-42f5-49c8-a72c-1db590a049b3 req-200b96dc-58da-41a1-b9af-f95338368209 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.2191019 Nov 18 18:24:19.030723 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23572a86-a9f3-43a2-a56c-4b0ab8666d33 req-098288b8-3463-4855-aec3-c516d9c96b87 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:19.032304 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-23572a86-a9f3-43a2-a56c-4b0ab8666d33 req-098288b8-3463-4855-aec3-c516d9c96b87 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1431782 Nov 18 18:24:19.068045 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-44932ea2-b675-4a4c-b3a1-c39718268ec6 req-5dfb0fea-be86-4e30-af16-20d2228435f4 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0823262 Nov 18 18:24:19.183298 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-23572a86-a9f3-43a2-a56c-4b0ab8666d33 req-0d278c22-47d5-40a0-a842-e7a39ecf808b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1266181 Nov 18 18:24:19.185963 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-5960eede-bda7-4ee6-aadf-1c2fa62cfb8b req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Deleting port 1b418eab-96c7-4da9-ba41-6e91026f7285 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:24:19.186942 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-5960eede-bda7-4ee6-aadf-1c2fa62cfb8b req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:19.196838 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44932ea2-b675-4a4c-b3a1-c39718268ec6 req-8d531cdd-ba0f-4328-a8ac-6c40d70a587a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:19.198628 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-44932ea2-b675-4a4c-b3a1-c39718268ec6 req-8d531cdd-ba0f-4328-a8ac-6c40d70a587a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 1099 time: 0.0769536 Nov 18 18:24:19.210359 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bd78a0a2-42f5-49c8-a72c-1db590a049b3 req-b312b67e-b2f3-49b9-a9a7-cd9d0e055aa0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2119248 Nov 18 18:24:19.417642 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44932ea2-b675-4a4c-b3a1-c39718268ec6 req-13b16548-96d3-4306-af84-6709d2d3c7b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:19.419424 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-44932ea2-b675-4a4c-b3a1-c39718268ec6 req-13b16548-96d3-4306-af84-6709d2d3c7b1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 921 time: 0.1829808 Nov 18 18:24:19.471686 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-44932ea2-b675-4a4c-b3a1-c39718268ec6 req-ee1edcf0-445a-46ab-83bc-d5da123e64b4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=13fa8d72-ea18-463c-9382-23f28f110133 HTTP/1.1" status: 200 len: 217 time: 0.0382912 Nov 18 18:24:19.507318 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-5960eede-bda7-4ee6-aadf-1c2fa62cfb8b req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] For port 1b418eab-96c7-4da9-ba41-6e91026f7285, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=1b418eab-96c7-4da9-ba41-6e91026f7285,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:24:19.507980 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-5960eede-bda7-4ee6-aadf-1c2fa62cfb8b req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:19.524460 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-5960eede-bda7-4ee6-aadf-1c2fa62cfb8b req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Calling delete_port for 1b418eab-96c7-4da9-ba41-6e91026f7285 owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:24:19.565993 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44932ea2-b675-4a4c-b3a1-c39718268ec6 req-b194fade-7dbf-42bf-bba5-0fed0fa58a3e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:19.567858 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-44932ea2-b675-4a4c-b3a1-c39718268ec6 req-b194fade-7dbf-42bf-bba5-0fed0fa58a3e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 HTTP/1.1" status: 200 len: 859 time: 0.0854607 Nov 18 18:24:19.630690 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-44932ea2-b675-4a4c-b3a1-c39718268ec6 req-27595380-1c47-4a79-b92f-4482a8a30152 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0345995 Nov 18 18:24:19.745778 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f6ec52-9962-4363-9824-9e096c75c031 req-94ac0ec4-c07b-4260-b7dc-f046f6d37319 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:19.746723 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-67f6ec52-9962-4363-9824-9e096c75c031 req-94ac0ec4-c07b-4260-b7dc-f046f6d37319 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.4430373 Nov 18 18:24:19.767520 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b052600b-07e0-4db3-b303-76f4069047a6 req-f066b452-d6da-4fc4-b89c-6af6dbdff1e4 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:19.775760 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b052600b-07e0-4db3-b303-76f4069047a6 req-f066b452-d6da-4fc4-b89c-6af6dbdff1e4 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 945 time: 0.4330401 Nov 18 18:24:19.896120 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-44932ea2-b675-4a4c-b3a1-c39718268ec6 req-ac2de296-4f93-4952-adf1-3901976b396c service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1987441 Nov 18 18:24:20.257301 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-5960eede-bda7-4ee6-aadf-1c2fa62cfb8b req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:20.270809 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['f3483de4-481b-47ac-8d51-f8457fd0bb85'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:24:20.353963 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-67f6ec52-9962-4363-9824-9e096c75c031 req-ac9ea92f-28bd-43e3-8097-317ce211b3ec tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5574436 Nov 18 18:24:20.429642 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b052600b-07e0-4db3-b303-76f4069047a6 req-58b6123f-a062-44a8-85e8-ba5e5be1f933 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6184967 Nov 18 18:24:20.431272 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Pushing event deleted for resources: {'Port': ['ID=1b418eab-96c7-4da9-ba41-6e91026f7285,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:20.524783 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-5960eede-bda7-4ee6-aadf-1c2fa62cfb8b req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] No DVR routers for this DVR port 1b418eab-96c7-4da9-ba41-6e91026f7285 on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:24:20.527688 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:20.528282 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:20.528779 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:20.532451 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:20.532949 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:20.533408 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:20.533850 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:20.534288 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:20.534718 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:20.535143 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:20.535959 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:20.535959 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:20.546357 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-5960eede-bda7-4ee6-aadf-1c2fa62cfb8b req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:20.553468 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5960eede-bda7-4ee6-aadf-1c2fa62cfb8b req-6dfe7d90-85be-4bca-a31d-a49dc2f9f4d8 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "DELETE /v2.0/ports/1b418eab-96c7-4da9-ba41-6e91026f7285 HTTP/1.1" status: 204 len: 173 time: 1.7754109 Nov 18 18:24:20.553736 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1528250f-fcf0-4087-bde5-cf0ed83e5cba', 'name': 'network-vif-deleted', 'tag': '1b418eab-96c7-4da9-ba41-6e91026f7285'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:24:20.557897 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f75fb39-73cb-4427-b514-3d2d48ad1571" -d '{"events": [{"server_uuid": "1528250f-fcf0-4087-bde5-cf0ed83e5cba", "name": "network-vif-deleted", "tag": "1b418eab-96c7-4da9-ba41-6e91026f7285"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:24:20.829313 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63237b1-a50e-4a45-a317-27b55e9c8206 req-4e35db77-d502-4b8d-8efd-d5e54f519533 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:20.831083 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e63237b1-a50e-4a45-a317-27b55e9c8206 req-4e35db77-d502-4b8d-8efd-d5e54f519533 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.2553649 Nov 18 18:24:20.844481 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f2401b7-4265-4983-b277-6fc3ecaf17cb req-d0445932-4ae8-477b-bc5e-4b553c15d6fc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:20.845973 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4f2401b7-4265-4983-b277-6fc3ecaf17cb req-d0445932-4ae8-477b-bc5e-4b553c15d6fc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.2719800 Nov 18 18:24:20.925427 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4f2401b7-4265-4983-b277-6fc3ecaf17cb req-92144e2b-1ade-42fa-ac47-eecdcf6e7644 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583258 Nov 18 18:24:20.929543 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e63237b1-a50e-4a45-a317-27b55e9c8206 req-1ebb9923-2e82-43ee-b9f4-bcdd10de54c6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0826669 Nov 18 18:24:21.124577 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b31f4e4a-a082-4317-b036-038718ab15df req-76487d20-a56d-442a-bede-e56a02d5b64b tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:21.126131 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b31f4e4a-a082-4317-b036-038718ab15df req-76487d20-a56d-442a-bede-e56a02d5b64b tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0609715 Nov 18 18:24:21.150745 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:21.164558 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b62e97-7b57-481f-9d32-6d0f04859052 req-a88a4afe-ba32-4bb9-be58-dd38c2636e15 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:21.166255 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-90b62e97-7b57-481f-9d32-6d0f04859052 req-a88a4afe-ba32-4bb9-be58-dd38c2636e15 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1282897 Nov 18 18:24:21.231568 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b31f4e4a-a082-4317-b036-038718ab15df req-4784e947-8d7f-43e1-9e0f-8092873c0fad tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0943427 Nov 18 18:24:21.260349 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-90b62e97-7b57-481f-9d32-6d0f04859052 req-50c86880-1821-469a-80ec-d619dbe650a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0809975 Nov 18 18:24:21.314624 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:24:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-172acefc-6948-47b3-875a-cbb1e6358cbc x-openstack-request-id: req-172acefc-6948-47b3-875a-cbb1e6358cbc {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:24:21.314934 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1528250f-fcf0-4087-bde5-cf0ed83e5cba", "name": "network-vif-deleted", "tag": "1b418eab-96c7-4da9-ba41-6e91026f7285", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:24:21.315193 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-172acefc-6948-47b3-875a-cbb1e6358cbc {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:24:21.315600 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1528250f-fcf0-4087-bde5-cf0ed83e5cba', 'name': 'network-vif-deleted', 'tag': '1b418eab-96c7-4da9-ba41-6e91026f7285', 'status': 'completed', 'code': 200} Nov 18 18:24:21.420798 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 1b418eab-96c7-4da9-ba41-6e91026f7285 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:24:21.498673 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: 1b418eab-96c7-4da9-ba41-6e91026f7285 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:24:21.499870 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 1b418eab-96c7-4da9-ba41-6e91026f7285 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:24:21.550467 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e00ebe18-bd61-4997-87e7-b1f674806773 req-ac93cf35-9d5d-4d60-a251-ebadc5f50c61 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.0580850 Nov 18 18:24:21.604563 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-551b68d8-3e4c-4dc6-a225-0355fac0abc6 req-93eacd0a-ac2d-4b9a-9714-54c2a009f1a7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:21.610431 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-551b68d8-3e4c-4dc6-a225-0355fac0abc6 req-93eacd0a-ac2d-4b9a-9714-54c2a009f1a7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0576906 Nov 18 18:24:21.713452 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-551b68d8-3e4c-4dc6-a225-0355fac0abc6 req-69af2432-ff61-4daa-b0eb-c1c9ee333992 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0965414 Nov 18 18:24:22.186337 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be330343-4561-4b79-9320-ff4b75ea0407 req-39fd9223-ecf8-42a4-8440-1f87e26ad57b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:22.187858 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-be330343-4561-4b79-9320-ff4b75ea0407 req-39fd9223-ecf8-42a4-8440-1f87e26ad57b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1633475 Nov 18 18:24:22.242883 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba05ff4c-c402-4c6f-aa34-4dbbf9de35fd req-1615086d-6e03-4849-9cc1-5fb94659e41f tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:22.244946 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ba05ff4c-c402-4c6f-aa34-4dbbf9de35fd req-1615086d-6e03-4849-9cc1-5fb94659e41f tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1916475 Nov 18 18:24:22.299045 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-be330343-4561-4b79-9320-ff4b75ea0407 req-f67cd276-2709-48bc-9516-de4403231a9f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0935900 Nov 18 18:24:22.339056 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ba05ff4c-c402-4c6f-aa34-4dbbf9de35fd req-688a6075-98e4-47a8-bd3d-146370954a5d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0878155 Nov 18 18:24:22.463440 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23d4ace7-2431-4c4e-96ac-c71a063cf2d8 req-44cef555-fee6-44f4-92aa-d3d5332d28dc tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:22.479364 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-23d4ace7-2431-4c4e-96ac-c71a063cf2d8 req-44cef555-fee6-44f4-92aa-d3d5332d28dc tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.1054373 Nov 18 18:24:22.546377 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afbb55de-3e8f-42a5-bc97-7fbc5284eb9e req-e1623dfd-6b08-4b45-826c-9c66e04585ee tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:22.554106 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-afbb55de-3e8f-42a5-bc97-7fbc5284eb9e req-e1623dfd-6b08-4b45-826c-9c66e04585ee tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0722618 Nov 18 18:24:22.639095 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-afbb55de-3e8f-42a5-bc97-7fbc5284eb9e req-50b6aeec-a8b6-4e51-b787-4d678820cf42 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0820105 Nov 18 18:24:22.668567 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-23d4ace7-2431-4c4e-96ac-c71a063cf2d8 req-c2950127-3a27-497f-817a-1ad515434a3f tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1882129 Nov 18 18:24:22.778544 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3aa071a7-1890-44a0-8f66-c91d4afa2d98 req-82e62d80-7f4b-4eaf-8382-22db4bcd8be2 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.0461855 Nov 18 18:24:22.911858 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1775c7f5-1f46-4bec-8de6-77bddca3b6e2 req-f9e74e65-ca63-464b-8d93-ad44624dfc9c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:22.919157 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1775c7f5-1f46-4bec-8de6-77bddca3b6e2 req-f9e74e65-ca63-464b-8d93-ad44624dfc9c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0911062 Nov 18 18:24:22.997478 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1775c7f5-1f46-4bec-8de6-77bddca3b6e2 req-b7e201ec-176c-48ed-aa48-70b27cef8a45 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772719 Nov 18 18:24:23.438171 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d728f6b-f08e-4c29-a400-036e60f5e0e9 req-b7f88d41-d085-4055-a705-7e9d47ef5241 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:23.439691 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1d728f6b-f08e-4c29-a400-036e60f5e0e9 req-b7f88d41-d085-4055-a705-7e9d47ef5241 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0561445 Nov 18 18:24:23.517178 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1d728f6b-f08e-4c29-a400-036e60f5e0e9 req-870988c6-4bb5-427e-b6a8-85f8cbf7d695 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0679989 Nov 18 18:24:23.525997 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-682dbf04-e055-4e68-a06a-97a00ebd0f52 req-6344a590-13a1-4ecf-afd8-f49e3d828e7e tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:23.527830 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-682dbf04-e055-4e68-a06a-97a00ebd0f52 req-6344a590-13a1-4ecf-afd8-f49e3d828e7e tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0872128 Nov 18 18:24:23.608537 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-682dbf04-e055-4e68-a06a-97a00ebd0f52 req-0f9c00c4-1e4f-4668-ba33-f94d872dc22e tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675890 Nov 18 18:24:23.845753 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d858beb-6b2f-4eaf-a19a-8c95d4c69fe0 req-7abdeaa9-6e60-4584-95d9-d429ea3cfa45 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:23.849426 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3d858beb-6b2f-4eaf-a19a-8c95d4c69fe0 req-7abdeaa9-6e60-4584-95d9-d429ea3cfa45 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0998361 Nov 18 18:24:23.860408 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72449a97-41ab-47cb-8e19-408e14d97dd0 req-abb62374-aee9-484a-bf35-3489eb63dae3 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:23.866054 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-72449a97-41ab-47cb-8e19-408e14d97dd0 req-abb62374-aee9-484a-bf35-3489eb63dae3 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.1172869 Nov 18 18:24:23.949327 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3d858beb-6b2f-4eaf-a19a-8c95d4c69fe0 req-2baed777-1ef8-4f2b-b03e-0a47ec3901e0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0820405 Nov 18 18:24:24.017935 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-72449a97-41ab-47cb-8e19-408e14d97dd0 req-fdf4d708-3be3-431c-b525-fee7c914a11e tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1333253 Nov 18 18:24:24.100872 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-214fac64-5d82-4408-a85a-cb814aa4aaaf req-2dbab474-0fbc-44d7-a09f-611ad10b1cab tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.0648108 Nov 18 18:24:24.166217 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27d433c2-9e4d-44f7-ac56-9435da4a6052 req-07da6d5c-ffa7-4f78-8f12-3cdadc65ddd8 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:24.176332 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-27d433c2-9e4d-44f7-ac56-9435da4a6052 req-07da6d5c-ffa7-4f78-8f12-3cdadc65ddd8 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0613060 Nov 18 18:24:24.278611 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-27d433c2-9e4d-44f7-ac56-9435da4a6052 req-65d51c79-2fc2-4aa5-8cab-2b4c23f684f0 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1009367 Nov 18 18:24:24.694804 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51aebe56-4952-4844-8cbd-aaecd75ac0cb req-9eb83ddd-a302-46cf-bc55-f5b41ead41ed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:24.703048 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-51aebe56-4952-4844-8cbd-aaecd75ac0cb req-9eb83ddd-a302-46cf-bc55-f5b41ead41ed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0874393 Nov 18 18:24:24.800356 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-51aebe56-4952-4844-8cbd-aaecd75ac0cb req-559af8a4-8578-41b5-abf6-7f024424429b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0963893 Nov 18 18:24:24.838693 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9092095e-303e-4212-baae-d91fa2e039e0 req-39a12815-e3fe-49a2-b4a6-dca2711a0441 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:24.841629 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9092095e-303e-4212-baae-d91fa2e039e0 req-39a12815-e3fe-49a2-b4a6-dca2711a0441 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1066535 Nov 18 18:24:24.924602 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9092095e-303e-4212-baae-d91fa2e039e0 req-4d896504-1a2f-4497-909f-603a058f01ce tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689394 Nov 18 18:24:25.140771 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b6705a-53e7-4304-9971-28d359917e99 req-aaf13ba9-d47d-48b8-aa43-c5efe12618ec tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:25.142544 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-39b6705a-53e7-4304-9971-28d359917e99 req-aaf13ba9-d47d-48b8-aa43-c5efe12618ec tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0983434 Nov 18 18:24:25.246156 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b10cdbac-7c7d-41e5-93a1-e7823f558cc5 req-9820fda7-4988-4c99-bbb9-456075b1008a tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:25.247751 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b10cdbac-7c7d-41e5-93a1-e7823f558cc5 req-9820fda7-4988-4c99-bbb9-456075b1008a tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.1042905 Nov 18 18:24:25.323660 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-39b6705a-53e7-4304-9971-28d359917e99 req-cc751c0c-a75e-4a36-ba8a-4bb50b4d493e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1419411 Nov 18 18:24:25.382485 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b10cdbac-7c7d-41e5-93a1-e7823f558cc5 req-5a0d69b8-8258-45c7-b862-e25f6d417c7d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1132808 Nov 18 18:24:25.580558 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3e2038f1-13af-4a79-b393-ea2161f64fa3 req-1267e580-fd5e-4e66-9b78-06e44ebb0a90 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.1266069 Nov 18 18:24:25.644863 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab1b9d3-efe6-4068-ba8c-ac4b5a609ba9 req-38db888a-df2a-44f6-82af-10608f3aa051 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:25.647002 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bab1b9d3-efe6-4068-ba8c-ac4b5a609ba9 req-38db888a-df2a-44f6-82af-10608f3aa051 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1825879 Nov 18 18:24:25.815027 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bab1b9d3-efe6-4068-ba8c-ac4b5a609ba9 req-9769dcfd-8cc7-4b46-ae90-5c8c644ffc56 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1620026 Nov 18 18:24:26.086683 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e1bab5-835f-452e-a3dc-271497291763 req-30bfac4e-8e4f-4d83-8fd4-daf227f20471 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:26.088667 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-16e1bab5-835f-452e-a3dc-271497291763 req-30bfac4e-8e4f-4d83-8fd4-daf227f20471 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1557028 Nov 18 18:24:26.161304 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-16e1bab5-835f-452e-a3dc-271497291763 req-c19f37fa-e65f-4789-94b1-0c5f7ce8f200 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0662439 Nov 18 18:24:26.175823 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6af93680-6b4d-468d-828d-725b9901aa8e req-997f8bb9-81df-4014-a5bb-9553c091d767 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:26.184288 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6af93680-6b4d-468d-828d-725b9901aa8e req-997f8bb9-81df-4014-a5bb-9553c091d767 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1418254 Nov 18 18:24:26.240074 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6af93680-6b4d-468d-828d-725b9901aa8e req-50e22392-c381-4949-9299-5a302c4ddded tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543430 Nov 18 18:24:26.511576 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e72f7315-3af3-4d74-a783-42df153bfaa1 req-53bf13d4-d1f6-461f-87db-cd13be83f006 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:26.513682 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e72f7315-3af3-4d74-a783-42df153bfaa1 req-53bf13d4-d1f6-461f-87db-cd13be83f006 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1124752 Nov 18 18:24:26.583124 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a47a3451-eae8-4000-846f-8798a55ae6cc req-1ba61189-319c-4589-9ce2-06453b0446c0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:26.593969 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a47a3451-eae8-4000-846f-8798a55ae6cc req-1ba61189-319c-4589-9ce2-06453b0446c0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.1349795 Nov 18 18:24:26.620539 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e72f7315-3af3-4d74-a783-42df153bfaa1 req-6bfaeb91-745b-46d8-bac7-82c15cad9245 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0913913 Nov 18 18:24:26.697568 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a47a3451-eae8-4000-846f-8798a55ae6cc req-72690df4-d7a2-48b3-9cd6-8a318a82d1c5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1044326 Nov 18 18:24:26.737013 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f64d60e4-46f1-4124-8290-81ca7c54f96a req-94a5ebec-113d-4881-b039-8870c3d3ef55 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.0381324 Nov 18 18:24:27.000247 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a22ef4f-8ff4-4780-a464-3e1e47c89149 req-def21d6e-561e-47b1-8483-dd204171f94d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:27.004489 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a22ef4f-8ff4-4780-a464-3e1e47c89149 req-def21d6e-561e-47b1-8483-dd204171f94d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0860522 Nov 18 18:24:27.060043 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a22ef4f-8ff4-4780-a464-3e1e47c89149 req-a5d9dbf3-f295-4beb-9961-dd9db15d0654 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504770 Nov 18 18:24:27.333825 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28cae654-ec33-4251-ad6a-01cfb6fe1f91 req-f87e801b-1d17-4589-a082-7c37dd2e3d6a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:27.348070 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-28cae654-ec33-4251-ad6a-01cfb6fe1f91 req-f87e801b-1d17-4589-a082-7c37dd2e3d6a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1038690 Nov 18 18:24:27.424910 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-28cae654-ec33-4251-ad6a-01cfb6fe1f91 req-2a2562d4-38e1-46dc-b463-fca2f10bc5b9 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0733604 Nov 18 18:24:27.460562 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7422cf0a-7484-47df-860c-3a8410b12ebd req-d5abea53-a2d5-4d4e-9322-4f37c81d47f5 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:27.462776 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7422cf0a-7484-47df-860c-3a8410b12ebd req-d5abea53-a2d5-4d4e-9322-4f37c81d47f5 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1078198 Nov 18 18:24:27.480829 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:24:27.549503 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7422cf0a-7484-47df-860c-3a8410b12ebd req-80ba23df-83ff-486a-8c19-0f5862f5bee9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0801752 Nov 18 18:24:27.777761 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5666ec1e-fff3-4ab8-9c25-72ddfbc8d913 req-1ee863a1-9d81-491d-9534-d693c9bdaa41 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:27.779816 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5666ec1e-fff3-4ab8-9c25-72ddfbc8d913 req-1ee863a1-9d81-491d-9534-d693c9bdaa41 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0714285 Nov 18 18:24:27.862914 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5666ec1e-fff3-4ab8-9c25-72ddfbc8d913 req-7ee7cad8-3869-48b1-a3b4-17e0793fba9f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0772150 Nov 18 18:24:27.922873 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91dd3e64-c0cb-4e42-b576-d937eea1ef8a req-6434b8c9-812a-4922-833c-0b8e6bbffe8d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:27.924757 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-91dd3e64-c0cb-4e42-b576-d937eea1ef8a req-6434b8c9-812a-4922-833c-0b8e6bbffe8d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0910850 Nov 18 18:24:28.008440 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-91dd3e64-c0cb-4e42-b576-d937eea1ef8a req-1261588f-8c05-4475-8767-27e87291018c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0772216 Nov 18 18:24:28.033948 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ab6425c7-23d3-4a4c-be59-8c4a135889a3 req-1bba1a2f-35eb-482c-bb10-673546d6ec6f tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.0506895 Nov 18 18:24:28.216991 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c341ce4b-4d3c-4dab-88b7-ff773e8d58be req-5f66bed3-f0d5-4370-98ab-c22a6fc63848 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:28.222180 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c341ce4b-4d3c-4dab-88b7-ff773e8d58be req-5f66bed3-f0d5-4370-98ab-c22a6fc63848 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0802474 Nov 18 18:24:28.271604 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c341ce4b-4d3c-4dab-88b7-ff773e8d58be req-390be2de-4943-4a38-844b-4d9db09aa2ca tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485156 Nov 18 18:24:28.575684 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c356ceaf-a095-41bc-a0e5-7eee89e1e73b req-d90cc6bc-962b-4a0a-b2ac-3759d219d678 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:28.577279 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c356ceaf-a095-41bc-a0e5-7eee89e1e73b req-d90cc6bc-962b-4a0a-b2ac-3759d219d678 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0737550 Nov 18 18:24:28.712791 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c356ceaf-a095-41bc-a0e5-7eee89e1e73b req-6b01aa73-45fe-4df3-b7cb-9790a5c15d06 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1279075 Nov 18 18:24:28.771889 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c462d54-58fc-4b69-b80c-b4b4b69f9391 req-be505f3e-a9ba-436d-8d6e-5f31fb5248ea tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:28.779327 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8c462d54-58fc-4b69-b80c-b4b4b69f9391 req-be505f3e-a9ba-436d-8d6e-5f31fb5248ea tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1334884 Nov 18 18:24:28.847614 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8c462d54-58fc-4b69-b80c-b4b4b69f9391 req-bf5aacb8-55b5-4b80-bd33-b795f29f63e1 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673509 Nov 18 18:24:29.179177 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc8573b3-2c22-411c-8e9d-783bc69df276 req-fb1efb3d-1efd-4ee3-bb02-fee20abd818c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:29.193158 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bc8573b3-2c22-411c-8e9d-783bc69df276 req-fb1efb3d-1efd-4ee3-bb02-fee20abd818c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.2403011 Nov 18 18:24:29.335002 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bc8573b3-2c22-411c-8e9d-783bc69df276 req-c05662d9-ecc3-4da8-a18b-179fdc6ede0b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1392059 Nov 18 18:24:29.363886 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b12f136-3537-4492-b786-2eb57aa16ad9 req-236941ad-1570-4c9e-a5cd-e93ff70916e2 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:29.365430 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2b12f136-3537-4492-b786-2eb57aa16ad9 req-236941ad-1570-4c9e-a5cd-e93ff70916e2 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0952990 Nov 18 18:24:29.480313 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2b12f136-3537-4492-b786-2eb57aa16ad9 req-19c9df6b-b20a-4bda-ab90-3b1f3e3b5ca6 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1054847 Nov 18 18:24:29.542447 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88b7b9a1-ffd1-4dbd-8dfe-db21057e7206 req-7826c280-61e8-4b13-9fa7-cf1dd2ca62f0 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.0606005 Nov 18 18:24:29.651360 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64752346-4202-4f96-9cdd-317f734b60e7 req-e96c2dbb-30ca-4bd2-b696-0d99ba89805f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:29.658811 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-64752346-4202-4f96-9cdd-317f734b60e7 req-e96c2dbb-30ca-4bd2-b696-0d99ba89805f tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0950801 Nov 18 18:24:29.715858 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-64752346-4202-4f96-9cdd-317f734b60e7 req-0dbfd7ed-6b48-45dd-979b-289ff8967928 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560379 Nov 18 18:24:29.913301 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c78ccdf-d8ea-41dd-a7a8-2d0e2995796f req-7fc98f32-2bdc-497b-a2ab-e5544b5ed5f3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:29.928991 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c78ccdf-d8ea-41dd-a7a8-2d0e2995796f req-7fc98f32-2bdc-497b-a2ab-e5544b5ed5f3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1076486 Nov 18 18:24:30.035404 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c78ccdf-d8ea-41dd-a7a8-2d0e2995796f req-051d25c0-532f-4d75-aaa2-6bf11ef03ce3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1044881 Nov 18 18:24:30.059703 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-181c580d-73c4-453a-a96d-1ba3c106e7fe req-ed596283-7006-49f6-afc8-78d15a690f90 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:30.068623 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-181c580d-73c4-453a-a96d-1ba3c106e7fe req-ed596283-7006-49f6-afc8-78d15a690f90 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0879107 Nov 18 18:24:30.143952 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-181c580d-73c4-453a-a96d-1ba3c106e7fe req-381ed311-e30c-4362-97f3-c6d69ba954d7 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748899 Nov 18 18:24:30.473476 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6527e934-1376-4588-99b0-18f9fd6f2c43 req-0957bc0e-b305-48e7-97da-0d191ddbd495 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:30.475475 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6527e934-1376-4588-99b0-18f9fd6f2c43 req-0957bc0e-b305-48e7-97da-0d191ddbd495 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0653443 Nov 18 18:24:30.543550 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6527e934-1376-4588-99b0-18f9fd6f2c43 req-f0d1468a-a75e-4015-b727-65826f346250 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0611141 Nov 18 18:24:30.673246 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a4cae3e6-beb6-48ab-b56e-e9ea8666eacf req-8fdc174b-e049-451a-9b95-4d0a995a13b1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.0316739 Nov 18 18:24:30.704990 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-572da313-64e2-4334-950f-f3e1b62bacab req-a051ae50-c864-4cdf-aee5-66062c5cfd93 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:30.706667 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-572da313-64e2-4334-950f-f3e1b62bacab req-a051ae50-c864-4cdf-aee5-66062c5cfd93 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.1069379 Nov 18 18:24:30.784667 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-572da313-64e2-4334-950f-f3e1b62bacab req-d74ffa7f-f058-4208-a46b-bd80b6b78828 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0664678 Nov 18 18:24:30.845505 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-359f502a-2ac6-4176-b4e5-05d924055dfb req-749074de-1e6e-434a-a371-f04e02cd7282 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:30.847475 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-359f502a-2ac6-4176-b4e5-05d924055dfb req-749074de-1e6e-434a-a371-f04e02cd7282 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0613811 Nov 18 18:24:30.920699 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-359f502a-2ac6-4176-b4e5-05d924055dfb req-26492990-1d23-4098-9a18-e7444cd2f0d2 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620544 Nov 18 18:24:31.202229 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e185e45-9e03-4541-b5ed-0e36443d0209 req-22163402-014b-4b59-a946-1f92d74f74c2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:31.212376 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8e185e45-9e03-4541-b5ed-0e36443d0209 req-22163402-014b-4b59-a946-1f92d74f74c2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0764945 Nov 18 18:24:31.295661 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8e185e45-9e03-4541-b5ed-0e36443d0209 req-65efa410-d666-428a-b724-e5f25ac78114 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0829511 Nov 18 18:24:31.342632 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc30fe6-1b1a-4af2-90ed-2e88f8fd0fc1 req-5b353f0d-eb69-4369-8153-c01a82b429e7 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:31.344129 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9cc30fe6-1b1a-4af2-90ed-2e88f8fd0fc1 req-5b353f0d-eb69-4369-8153-c01a82b429e7 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0989256 Nov 18 18:24:31.452869 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9cc30fe6-1b1a-4af2-90ed-2e88f8fd0fc1 req-aeb33844-1e22-4655-8286-b5376a5b5e60 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0980403 Nov 18 18:24:31.858054 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-10d0f5f6-7b49-4a3c-a6d7-4e11ad989363 req-5ed09361-a7f6-44fe-859c-549118899e5e tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.0423765 Nov 18 18:24:31.878397 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2fac3b0-44ff-40f4-9f7a-6761605a47d9 req-dc075edd-3e8e-4cbd-be62-89d939a07cc5 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:31.897428 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e2fac3b0-44ff-40f4-9f7a-6761605a47d9 req-dc075edd-3e8e-4cbd-be62-89d939a07cc5 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1712649 Nov 18 18:24:31.990881 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e2fac3b0-44ff-40f4-9f7a-6761605a47d9 req-62434da4-08e5-4f32-bfa8-90d50b9d4e35 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0917614 Nov 18 18:24:32.032265 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce62faa5-5436-49ae-bc2a-2b21cbb418c5 req-b4b0d13f-5303-4cdc-bbaa-44ed26ebd5ab tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:32.034018 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ce62faa5-5436-49ae-bc2a-2b21cbb418c5 req-b4b0d13f-5303-4cdc-bbaa-44ed26ebd5ab tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0742395 Nov 18 18:24:32.130907 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ce62faa5-5436-49ae-bc2a-2b21cbb418c5 req-2779b449-fdc8-4bbf-9774-2017bbdb28b5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0903342 Nov 18 18:24:32.173435 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f85477c-7df1-4542-ad19-1a28e56d89f3 req-ae64bcb2-15fc-444c-9dda-799ac6c6a1d6 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:32.177753 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0f85477c-7df1-4542-ad19-1a28e56d89f3 req-ae64bcb2-15fc-444c-9dda-799ac6c6a1d6 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1002374 Nov 18 18:24:32.230188 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0f85477c-7df1-4542-ad19-1a28e56d89f3 req-186ae6ac-4150-4dcd-8cf3-58b1514e4aa2 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482757 Nov 18 18:24:32.424898 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0714652a-c74e-4811-a7f4-d74a209cfc1a req-1782eb39-6d50-4658-9603-121a32b2428c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:32.426581 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0714652a-c74e-4811-a7f4-d74a209cfc1a req-1782eb39-6d50-4658-9603-121a32b2428c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.0536113 Nov 18 18:24:32.508774 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0714652a-c74e-4811-a7f4-d74a209cfc1a req-80c77c7e-ad09-4769-a45e-0f982b902285 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0757270 Nov 18 18:24:32.643633 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07cf0b39-7e86-4448-a14b-6717b740012e req-8f73bdf9-23e4-4f22-b25f-e613685a3a0c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:32.645239 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-07cf0b39-7e86-4448-a14b-6717b740012e req-8f73bdf9-23e4-4f22-b25f-e613685a3a0c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0913761 Nov 18 18:24:32.720356 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-44932ea2-b675-4a4c-b3a1-c39718268ec6 req-956d8d32-be51-49ac-9832-00d722f5a5d6 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2353981 Nov 18 18:24:32.751532 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-07cf0b39-7e86-4448-a14b-6717b740012e req-084da0c5-47d9-4cb1-9c0b-470947af953b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0992351 Nov 18 18:24:33.098634 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-502bb583-9346-4de0-9408-031abc72f273 req-ad68a971-5dea-4c5b-ac28-e532c8dad369 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=1528250f-fcf0-4087-bde5-cf0ed83e5cba HTTP/1.1" status: 200 len: 210 time: 0.0872183 Nov 18 18:24:33.201721 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f6fa6a1-3962-4952-bdbc-28f4d84879a9 req-c6585223-69e7-4cb9-a2e0-a6e0eef0097b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:33.203677 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3f6fa6a1-3962-4952-bdbc-28f4d84879a9 req-c6585223-69e7-4cb9-a2e0-a6e0eef0097b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0658898 Nov 18 18:24:33.311743 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3f6fa6a1-3962-4952-bdbc-28f4d84879a9 req-4c5dee23-c890-4250-acd1-5a07d11c41e9 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1014836 Nov 18 18:24:33.369156 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4e74b4c-2229-404a-bbe2-d1c88981f75c req-0acb66c7-21a2-4254-8671-fdf03279848f tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:33.376188 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a4e74b4c-2229-404a-bbe2-d1c88981f75c req-0acb66c7-21a2-4254-8671-fdf03279848f tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.1231041 Nov 18 18:24:33.477374 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a4e74b4c-2229-404a-bbe2-d1c88981f75c req-e2f42b39-d532-429e-883c-438cc1d70eff tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1002162 Nov 18 18:24:33.519534 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8673ecf-d000-4996-9292-6e816c2fc1ac req-93ab5ec7-14ac-40ed-a61e-25d7415a4cfd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:33.521843 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f8673ecf-d000-4996-9292-6e816c2fc1ac req-93ab5ec7-14ac-40ed-a61e-25d7415a4cfd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1222003 Nov 18 18:24:33.596230 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f8673ecf-d000-4996-9292-6e816c2fc1ac req-7453e90c-bef5-4b51-b5e6-28eb1211864e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684783 Nov 18 18:24:33.820378 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a07a6f0-fd2c-4463-95b1-2159b8717ac6 req-2d3ecac6-5403-4199-97e6-191be7713022 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:33.822462 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-4a07a6f0-fd2c-4463-95b1-2159b8717ac6 req-2d3ecac6-5403-4199-97e6-191be7713022 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1bab99f3344342578dc7b1c29b1ced7e&device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 1098 time: 0.0433190 Nov 18 18:24:33.826294 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf92d2b3-decd-4f89-b27d-26d460d9dfbe req-4def380d-8772-4419-b325-c6bce09c2591 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:33.828575 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-cf92d2b3-decd-4f89-b27d-26d460d9dfbe req-4def380d-8772-4419-b325-c6bce09c2591 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.1250300 Nov 18 18:24:33.840202 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3a745b0-2a60-4ebb-bb8f-bb842f40db17 req-23cfdf86-77c0-47af-a2e0-0f1b4642f6f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:33.841730 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e3a745b0-2a60-4ebb-bb8f-bb842f40db17 req-23cfdf86-77c0-47af-a2e0-0f1b4642f6f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.1275065 Nov 18 18:24:33.941869 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a07a6f0-fd2c-4463-95b1-2159b8717ac6 req-3781a9b5-9bcb-4067-be73-db9d89f88369 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:33.943589 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-4a07a6f0-fd2c-4463-95b1-2159b8717ac6 req-3781a9b5-9bcb-4067-be73-db9d89f88369 service neutron] 10.222.0.31 "GET /v2.0/networks?id=f2a08e65-1c6c-43fe-a019-78643e62bd9f HTTP/1.1" status: 200 len: 912 time: 0.1109886 Nov 18 18:24:33.943993 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-cf92d2b3-decd-4f89-b27d-26d460d9dfbe req-bcc70d1b-1600-40b4-b857-003cd5178183 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0988543 Nov 18 18:24:33.987756 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e3a745b0-2a60-4ebb-bb8f-bb842f40db17 req-d7512dee-8ada-494a-8646-e57d3a197da2 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1376705 Nov 18 18:24:34.003898 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3f89dbf0-0b90-4bc4-b636-1283fd6c8f63 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:34.020429 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 40660) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:34.060914 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-4a07a6f0-fd2c-4463-95b1-2159b8717ac6 req-66598e1c-8988-48c4-b1c6-0b88e1174373 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f HTTP/1.1" status: 200 len: 1001 time: 0.0937862 Nov 18 18:24:34.123866 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da32e269-2d48-4f03-9040-02ac108480bf req-1bb3a747-6978-4763-a314-8e3d5067419e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:34.126618 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-da32e269-2d48-4f03-9040-02ac108480bf req-1bb3a747-6978-4763-a314-8e3d5067419e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0750380 Nov 18 18:24:34.133449 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a07a6f0-fd2c-4463-95b1-2159b8717ac6 req-606a9360-5996-47a1-b4b7-b1fd247add31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:34.134958 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-4a07a6f0-fd2c-4463-95b1-2159b8717ac6 req-606a9360-5996-47a1-b4b7-b1fd247add31 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=53535ce7-7c2a-450f-87e4-d092908ff080 HTTP/1.1" status: 200 len: 849 time: 0.0562234 Nov 18 18:24:34.204920 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a07a6f0-fd2c-4463-95b1-2159b8717ac6 req-ada7fd06-5c69-41e4-a191-cb4313b97366 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:34.206858 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-4a07a6f0-fd2c-4463-95b1-2159b8717ac6 req-ada7fd06-5c69-41e4-a191-cb4313b97366 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f2a08e65-1c6c-43fe-a019-78643e62bd9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0552714 Nov 18 18:24:34.218792 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df0b9e6-97b7-4099-b597-637b869ac81c req-a64090f9-9e41-4089-9565-1fadb0ffd9f5 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:34.220298 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1df0b9e6-97b7-4099-b597-637b869ac81c req-a64090f9-9e41-4089-9565-1fadb0ffd9f5 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.0924931 Nov 18 18:24:34.224785 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-da32e269-2d48-4f03-9040-02ac108480bf req-d608f198-9aae-42e3-a386-2716c7d9128b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0858464 Nov 18 18:24:34.322819 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1df0b9e6-97b7-4099-b597-637b869ac81c req-ecd6ab05-4ad4-4a10-a922-f422762a7353 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0877302 Nov 18 18:24:34.341533 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9de2159f-4158-4b3c-968a-37da315efef6 tempest-TestShelveInstance-2051555130 tempest-TestShelveInstance-2051555130-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:34.346250 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-9de2159f-4158-4b3c-968a-37da315efef6 tempest-TestShelveInstance-2051555130 tempest-TestShelveInstance-2051555130-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 1094 time: 0.3247349 Nov 18 18:24:34.346992 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 40670) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:34.351387 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Request body: {'floatingip': {'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'port_id': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'fixed_ip_address': '172.20.0.10'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:24:34.358391 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-4a07a6f0-fd2c-4463-95b1-2159b8717ac6 req-215272ba-dacb-4155-841b-611bf7cda8bf service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1309674 Nov 18 18:24:34.378092 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for floatingip, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:34.489257 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:34.507401 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-4a07a6f0-fd2c-4463-95b1-2159b8717ac6 req-73abc9de-06fb-428f-83db-27fe45d9e34a service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1248670 Nov 18 18:24:34.598438 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Allocated IP 172.27.1.45 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/8c822430-30a9-4247-8f8c-5b8757442b3d) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:24:34.640507 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80d6bccf-82c3-43d1-9cce-19c3c94b6e76 req-2c48aee1-4d92-4bdf-be82-d75a6dc4e867 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:34.642252 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-80d6bccf-82c3-43d1-9cce-19c3c94b6e76 req-2c48aee1-4d92-4bdf-be82-d75a6dc4e867 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 1098 time: 0.0444217 Nov 18 18:24:34.696518 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-80d6bccf-82c3-43d1-9cce-19c3c94b6e76 req-2faac297-f98b-4c98-bee7-287c7432714d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450487 Nov 18 18:24:34.761084 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a5f55b3-83e2-4eb8-b343-ce92f00e9668 req-a8f0edba-c0d9-40b3-8bc4-7f5ff77c9bb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:34.762626 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7a5f55b3-83e2-4eb8-b343-ce92f00e9668 req-a8f0edba-c0d9-40b3-8bc4-7f5ff77c9bb3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 1098 time: 0.1276073 Nov 18 18:24:34.769207 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:34.791821 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87260e46-b797-4b56-a416-78018e1abde8 req-03a9b675-1114-4f18-8f0d-6284487ca35c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:34.793291 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-87260e46-b797-4b56-a416-78018e1abde8 req-03a9b675-1114-4f18-8f0d-6284487ca35c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0923643 Nov 18 18:24:34.835670 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:34.886312 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:24:34.889949 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-87260e46-b797-4b56-a416-78018e1abde8 req-ed4cec30-3ecb-4814-a527-a9e803526851 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0900791 Nov 18 18:24:34.892769 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:24:34.896269 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:24:34.903947 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event updated for resources: {'Port': ['ID=8c822430-30a9-4247-8f8c-5b8757442b3d,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:35.138155 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 40682) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:35.183153 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_v2 [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Deleting subnet d477b94e-c409-446d-9434-db6811cbe863 {{(pid=102688) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:24:35.186435 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.225958 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.235476 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.299595 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for subnet, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.307756 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a5f55b3-83e2-4eb8-b343-ce92f00e9668 req-4e93edc8-5552-4ecb-922d-0f95b74913d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:35.309284 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7a5f55b3-83e2-4eb8-b343-ce92f00e9668 req-4e93edc8-5552-4ecb-922d-0f95b74913d2 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 919 time: 0.3859921 Nov 18 18:24:35.328447 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Publish callbacks [] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.331645 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] 10.222.0.82 "DELETE /v2.0/subnets/d477b94e-c409-446d-9434-db6811cbe863 HTTP/1.1" status: 204 len: 168 time: 0.1924882 Nov 18 18:24:35.332478 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d477b94e-c409-446d-9434-db6811cbe863,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:35.334945 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 40686) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:35.356019 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.356365 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.356713 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.357058 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.357400 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.357739 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.358072 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.358404 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.358739 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.359067 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.359392 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.359715 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b3f2ba0-6cef-4508-ab98-79c90ca4896a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.420496 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.422393 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-286daf97-8666-41ac-9e36-7a9106312737 req-b86dbd47-0bed-4c75-9d42-5184b9c7add5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:35.423880 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-286daf97-8666-41ac-9e36-7a9106312737 req-b86dbd47-0bed-4c75-9d42-5184b9c7add5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.2034800 Nov 18 18:24:35.485057 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7a5f55b3-83e2-4eb8-b343-ce92f00e9668 req-025b7037-994d-4954-9389-a772c229374d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b8ded38f-97b4-485b-9845-705c1fb9701d HTTP/1.1" status: 200 len: 1001 time: 0.1451001 Nov 18 18:24:35.492543 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12298377-4569-441a-bb14-7cc623adb41c req-84b0f606-b31b-491a-8cf9-47fdbe27b8d3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:35.493933 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-12298377-4569-441a-bb14-7cc623adb41c req-84b0f606-b31b-491a-8cf9-47fdbe27b8d3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1908288 Nov 18 18:24:35.503685 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.523097 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device e535328b-e6c3-4630-a314-5bd8ccdaad80 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:24:35.528456 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.528799 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.529587 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.529839 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > port after_create 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.530189 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.530518 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > port after_update 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.530836 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.531165 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.531475 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.531790 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.619263 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-286daf97-8666-41ac-9e36-7a9106312737 req-7bd4ac82-b08b-469b-8332-4fa2c876a244 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1824374 Nov 18 18:24:35.677385 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a5f55b3-83e2-4eb8-b343-ce92f00e9668 req-f3b4f2cf-235c-4592-8f62-15de63c7aba0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:35.678830 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7a5f55b3-83e2-4eb8-b343-ce92f00e9668 req-f3b4f2cf-235c-4592-8f62-15de63c7aba0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 200 len: 856 time: 0.1549613 Nov 18 18:24:35.681823 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port e535328b-e6c3-4630-a314-5bd8ccdaad80, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:24:35.683529 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.684229 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.684630 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.685029 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102688) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 18:24:35.685473 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f06fa801-dbf4-454b-984e-82c11cc6c900']}} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:24:35.686762 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-12298377-4569-441a-bb14-7cc623adb41c req-bd82fdf7-4884-47e0-bbd2-4ac18003da29 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1655388 Nov 18 18:24:35.712514 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20') {'for_net_delete': True} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:24:35.712732 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd50bfa7e-cb57-4ac2-a7b9-8ab758fd5a20') {} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:24:35.717431 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'port_id': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'mac_address': 'fa:16:3e:43:14:46', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1305, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:24:35.733455 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14253766'] for segment, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.760518 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.784210 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Releasing vlan 1333 on physical network physnet1 to pool {{(pid=102688) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:24:35.784811 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-13993202'] for segment, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: from cryptography.utils import int_from_bytes Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: from cryptography.utils import int_from_bytes Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: Traceback (most recent call last): Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: timer() Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: cb(*args, **kw) Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: return func(*args, **kwargs) Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: self._notify() Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: self.callback(batched_events) Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: event.method(event) Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: return f(self, *a, **k) Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._get(url).json() Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: return self.request(url, 'GET', **kwargs) Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:24:35.790657 dv-cinder-787764-6-iscsi neutron-server[102688]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:24:35.797478 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.799591 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a5f55b3-83e2-4eb8-b343-ce92f00e9668 req-5e6c8afc-d616-4ecd-b4a8-f487909b08b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:35.801107 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7a5f55b3-83e2-4eb8-b343-ce92f00e9668 req-5e6c8afc-d616-4ecd-b4a8-f487909b08b4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d845755f-6a59-4935-8123-1a70c6e45968&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1120059 Nov 18 18:24:35.817769 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e535328b-e6c3-4630-a314-5bd8ccdaad80 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:24:35.848679 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port e535328b-e6c3-4630-a314-5bd8ccdaad80, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:24:35.854575 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.859039 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.869549 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.875950 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] 10.222.0.82 "DELETE /v2.0/networks/f06fa801-dbf4-454b-984e-82c11cc6c900 HTTP/1.1" status: 204 len: 168 time: 0.5400019 Nov 18 18:24:35.886923 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a469f7d4-3b62-4145-81c8-d49a228ecf16 admin admin] Pushing event deleted for resources: {'Network': ['ID=f06fa801-dbf4-454b-984e-82c11cc6c900,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:35.911781 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:35.920881 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdc3fb4-0907-4ced-a436-e716ab28ecdc req-40ee78f6-f6f9-4cee-a0ee-e8bd1520c3eb tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:35.922413 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9fdc3fb4-0907-4ced-a436-e716ab28ecdc req-40ee78f6-f6f9-4cee-a0ee-e8bd1520c3eb tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 944 time: 0.1595078 Nov 18 18:24:35.937792 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=e535328b-e6c3-4630-a314-5bd8ccdaad80,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:35.946030 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.946574 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.947199 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.947832 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.948353 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.948850 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.949335 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.951442 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.951990 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.952536 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.953041 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:35.953530 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:24:36.062642 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7a5f55b3-83e2-4eb8-b343-ce92f00e9668 req-5e0f6e54-225a-4d38-9dc8-1bf32f8a9f7a service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2292099 Nov 18 18:24:36.105513 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9fdc3fb4-0907-4ced-a436-e716ab28ecdc req-8765dedb-bf7b-4366-9b03-5b33ca43d173 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1400957 Nov 18 18:24:36.114970 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 40702) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:36.133852 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b5c56f-ed2a-44bb-8926-f8b1d9dff2f6 req-ff455201-4621-40c3-b08b-f41353bab8dc tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:36.135367 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-11b5c56f-ed2a-44bb-8926-f8b1d9dff2f6 req-ff455201-4621-40c3-b08b-f41353bab8dc tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1458335 Nov 18 18:24:36.137739 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:36.168230 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-c6c4b966-7425-403e-b6a4-4d462c3fe716 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=472f1c3f9a614eacab1165cd06691e36&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0515037 Nov 18 18:24:36.168813 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 40704) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:36.218937 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a468b66c-d0b0-4db8-8019-08721d36668b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:36.249577 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a468b66c-d0b0-4db8-8019-08721d36668b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:36.298785 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['e535328b-e6c3-4630-a314-5bd8ccdaad80'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:24:36.307635 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7a5f55b3-83e2-4eb8-b343-ce92f00e9668 req-0f72c242-55b1-4bcd-b128-273dc05a72d4 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2148631 Nov 18 18:24:36.313258 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a468b66c-d0b0-4db8-8019-08721d36668b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:36.315655 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-11b5c56f-ed2a-44bb-8926-f8b1d9dff2f6 req-3f824f4a-8bdc-4a05-a4f6-835c3b50064d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1678288 Nov 18 18:24:36.316597 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a468b66c-d0b0-4db8-8019-08721d36668b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:36.317918 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a468b66c-d0b0-4db8-8019-08721d36668b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ff5c1222-8b6f-43f9-a79e-85bbc10341c5 HTTP/1.1" status: 204 len: 168 time: 0.1481850 Nov 18 18:24:36.343741 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a468b66c-d0b0-4db8-8019-08721d36668b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff5c1222-8b6f-43f9-a79e-85bbc10341c5,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:36.368069 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b23747-6f09-4378-9f3a-939b4913e9b1 req-a6e40644-4352-4bd5-9a2a-f6153edb0aca tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:36.369598 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-57b23747-6f09-4378-9f3a-939b4913e9b1 req-a6e40644-4352-4bd5-9a2a-f6153edb0aca tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 945 time: 0.1698868 Nov 18 18:24:36.444173 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-90ee9942-f555-488b-be2f-9db92770e13c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:36.470580 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-57b23747-6f09-4378-9f3a-939b4913e9b1 req-aac0fd1f-5fbe-45ef-8cc9-e0b314629f9c tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0896294 Nov 18 18:24:36.499699 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:36.503747 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:36.573905 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event updated for resources: {'Port': ['ID=8c822430-30a9-4247-8f8c-5b8757442b3d,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:36.583917 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:36.694132 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Floating IP f68ff9ac-17c9-4d9e-b90b-0cf8d3efecc5 associated. External IP: 172.27.1.45, port: 85e36ba2-dd4d-47c9-b794-f9104af3235f. Nov 18 18:24:37.089065 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20199c21-9ba1-47f4-9bd7-435c8b7375f0 req-544b1c29-f1de-44cc-81a9-bb8e413f38f9 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:37.090789 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-20199c21-9ba1-47f4-9bd7-435c8b7375f0 req-544b1c29-f1de-44cc-81a9-bb8e413f38f9 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 945 time: 0.3492744 Nov 18 18:24:37.105328 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-764b223f-d6be-4826-8dcb-50bd04aa1fcd req-aab0dd78-9f32-40e4-ad76-0aba44209c6f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:37.106753 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-764b223f-d6be-4826-8dcb-50bd04aa1fcd req-aab0dd78-9f32-40e4-ad76-0aba44209c6f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.3319383 Nov 18 18:24:37.251785 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-20199c21-9ba1-47f4-9bd7-435c8b7375f0 req-1e1892d1-0d42-4162-bf65-97239997d4c6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1541762 Nov 18 18:24:37.265145 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-764b223f-d6be-4826-8dcb-50bd04aa1fcd req-55e5a2c1-d05f-4f56-b572-757ce7e05d0a tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1517916 Nov 18 18:24:37.294739 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Router 0f9804e2-48c3-4648-b16c-33eeec3a9305 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:24:37.453472 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2621938b-01f5-48a5-9bc8-b769213b163b req-4a916d02-6a06-4760-9e2f-cab57ad937f4 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:37.454878 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2621938b-01f5-48a5-9bc8-b769213b163b req-4a916d02-6a06-4760-9e2f-cab57ad937f4 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 945 time: 0.1174710 Nov 18 18:24:37.475091 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:24:37.485717 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77798d00-5f68-43bb-96a6-c72a10bee9f0 None None] Sync routers for ids ['0f9804e2-48c3-4648-b16c-33eeec3a9305'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:24:37.506844 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77798d00-5f68-43bb-96a6-c72a10bee9f0 None None] Routers {'0f9804e2-48c3-4648-b16c-33eeec3a9305'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:24:37.507460 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-77798d00-5f68-43bb-96a6-c72a10bee9f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:24:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['0f9804e2-48c3-4648-b16c-33eeec3a9305'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:24:37.512381 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:37.532518 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device e535328b-e6c3-4630-a314-5bd8ccdaad80 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:24:37.535831 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 40748) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:37.538147 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd38180c-f022-4922-889a-b35c68aeaba2 req-8d9ed762-675e-4a33-b9bf-22a3c7715783 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:37.539650 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dd38180c-f022-4922-889a-b35c68aeaba2 req-8d9ed762-675e-4a33-b9bf-22a3c7715783 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1274304 Nov 18 18:24:37.565655 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-78708665-e4a7-4df9-8271-ea580a92d0f9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.2176297 Nov 18 18:24:37.572400 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:24:37.574587 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9b107566-c39e-4a55-8cba-7b370c91a3e9" -d '{"events": [{"name": "network-changed", "server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:24:37.581269 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2621938b-01f5-48a5-9bc8-b769213b163b req-0e94da71-9138-4862-8735-d2dc61b2906e tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1181521 Nov 18 18:24:37.611314 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dd38180c-f022-4922-889a-b35c68aeaba2 req-0fb74b58-8f1c-4f07-8500-4872c2d2a7bd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589631 Nov 18 18:24:37.618477 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-77798d00-5f68-43bb-96a6-c72a10bee9f0 None None] Set router 0f9804e2-48c3-4648-b16c-33eeec3a9305 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:24:37.657179 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port e535328b-e6c3-4630-a314-5bd8ccdaad80 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:24:37.662618 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port e535328b-e6c3-4630-a314-5bd8ccdaad80 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:24:37.666818 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:37.684805 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:24:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91967be7-d45f-4dcb-9152-7d4dce8777bd x-openstack-request-id: req-91967be7-d45f-4dcb-9152-7d4dce8777bd {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:24:37.685104 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:24:37.685414 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-91967be7-d45f-4dcb-9152-7d4dce8777bd {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:24:37.685819 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'status': 'completed', 'code': 200} Nov 18 18:24:37.749097 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-de9c9903-db62-49d1-bbb9-fc5b25a75006 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:37.773998 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:37.840200 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5003a2-d4db-464a-9231-bf18c1408ad5 req-5907b56d-06a6-41dd-805c-94de0804d47a tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:37.840438 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:37.842306 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2f5003a2-d4db-464a-9231-bf18c1408ad5 req-5907b56d-06a6-41dd-805c-94de0804d47a tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 945 time: 0.1392241 Nov 18 18:24:37.848149 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b107566-c39e-4a55-8cba-7b370c91a3e9 req-0f1fe777-1193-4ea6-839b-8e1176a7e90d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:37.850570 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9b107566-c39e-4a55-8cba-7b370c91a3e9 req-0f1fe777-1193-4ea6-839b-8e1176a7e90d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=029e580af1e3498aa00c86f5ce660a80&device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 1099 time: 0.1107671 Nov 18 18:24:37.916106 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:24:37.918383 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-492ebca5-8d56-4581-b8d0-0b822f077186" -d '{"events": [{"server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "name": "network-vif-plugged", "status": "completed", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:24:37.937574 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-de9c9903-db62-49d1-bbb9-fc5b25a75006 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:37.943003 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port e535328b-e6c3-4630-a314-5bd8ccdaad80, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:24:37.947685 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-de9c9903-db62-49d1-bbb9-fc5b25a75006 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:37.964341 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:37.965858 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b8ded38f-97b4-485b-9845-705c1fb9701d no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:24:37.992790 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-de9c9903-db62-49d1-bbb9-fc5b25a75006 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3bf7310776654079b857206d14772fff&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4553764 Nov 18 18:24:37.994088 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de9c9903-db62-49d1-bbb9-fc5b25a75006 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6942b0c-5931-4573-8310-52a2259db420,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:38.002798 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b107566-c39e-4a55-8cba-7b370c91a3e9 req-d3bc9d20-3294-41ad-8c4b-96043e5c3ca1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:38.004530 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9b107566-c39e-4a55-8cba-7b370c91a3e9 req-d3bc9d20-3294-41ad-8c4b-96043e5c3ca1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a HTTP/1.1" status: 200 len: 909 time: 0.1353118 Nov 18 18:24:38.008838 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 40772) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:38.078017 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-77798d00-5f68-43bb-96a6-c72a10bee9f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:16Z', 'revision_number': 4, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': 'f68ff9ac-17c9-4d9e-b90b-0cf8d3efecc5', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'floating_ip_address': '172.27.1.45', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'port_id': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 370, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'mac_address': 'fa:16:3e:8d:d3:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:24:35Z', 'updated_at': '2021-11-18T18:24:35Z', 'revision_number': 0, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4f9ac680-4b89-4f65-bc06-6239f90f19f3', 'name': '', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'mac_address': 'fa:16:3e:ae:a5:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_interface', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:16Z', 'updated_at': '2021-11-18T18:23:20Z', 'revision_number': 5, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'subnets': [{'id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:24:38.101363 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:24:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8202b8b1-5c91-43fe-a474-379712df431b x-openstack-request-id: req-8202b8b1-5c91-43fe-a474-379712df431b {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:24:38.101686 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "name": "network-vif-plugged", "status": "completed", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:24:38.101946 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-8202b8b1-5c91-43fe-a474-379712df431b {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:24:38.103891 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2f5003a2-d4db-464a-9231-bf18c1408ad5 req-664b80c8-726c-4335-be8c-d313e8ba29d0 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2520871 Nov 18 18:24:38.104093 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'code': 200} Nov 18 18:24:38.119959 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9b107566-c39e-4a55-8cba-7b370c91a3e9 req-b51654e5-19ac-4e8f-9ee3-eb66d4888326 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f HTTP/1.1" status: 200 len: 999 time: 0.0970337 Nov 18 18:24:38.188028 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77798d00-5f68-43bb-96a6-c72a10bee9f0 None None] Checking router: 0f9804e2-48c3-4648-b16c-33eeec3a9305 for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:24:38.210995 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77798d00-5f68-43bb-96a6-c72a10bee9f0 None None] Routers {'0f9804e2-48c3-4648-b16c-33eeec3a9305'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:24:38.211622 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-77798d00-5f68-43bb-96a6-c72a10bee9f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:24:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['0f9804e2-48c3-4648-b16c-33eeec3a9305'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:24:38.215824 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=e535328b-e6c3-4630-a314-5bd8ccdaad80,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:38.235785 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-512d53ec-6c96-4cf9-9b53-c530347d4270 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:38.283468 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:38.294485 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e147fdeb-1568-4328-afd8-6aa73133e4e7 req-d10d2af1-2159-4731-a863-86d93adc3dfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:38.296029 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e147fdeb-1568-4328-afd8-6aa73133e4e7 req-d10d2af1-2159-4731-a863-86d93adc3dfb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 1098 time: 0.1862197 Nov 18 18:24:38.308340 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-512d53ec-6c96-4cf9-9b53-c530347d4270 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:38.333490 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b8ded38f-97b4-485b-9845-705c1fb9701d,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:24:38.345945 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:38.359721 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b107566-c39e-4a55-8cba-7b370c91a3e9 req-bdae83d5-1ff2-44c3-9975-3978e7097393 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:38.361560 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9b107566-c39e-4a55-8cba-7b370c91a3e9 req-bdae83d5-1ff2-44c3-9975-3978e7097393 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cac1be0a-3676-49bd-8292-3623cc0fc8b1 HTTP/1.1" status: 200 len: 846 time: 0.2243996 Nov 18 18:24:38.384432 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c227ca6-3c7d-4aaf-b611-81080d5ce4c8 req-445cdb32-4bcf-4e0d-a94c-ff297624a5c4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:38.386837 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7c227ca6-3c7d-4aaf-b611-81080d5ce4c8 req-445cdb32-4bcf-4e0d-a94c-ff297624a5c4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1804240 Nov 18 18:24:38.431430 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=b8ded38f-97b4-485b-9845-705c1fb9701d,revision_number=8']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:38.455874 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-77798d00-5f68-43bb-96a6-c72a10bee9f0 None None] Set router 0f9804e2-48c3-4648-b16c-33eeec3a9305 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:24:38.493495 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86be0f8d-5770-44a5-9bd4-1ae3c70a55fe req-34237064-6f74-4900-b8d0-ec13bd3f77c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:38.495335 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-86be0f8d-5770-44a5-9bd4-1ae3c70a55fe req-34237064-6f74-4900-b8d0-ec13bd3f77c0 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 1099 time: 0.1294005 Nov 18 18:24:38.527159 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-512d53ec-6c96-4cf9-9b53-c530347d4270 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:38.530317 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-512d53ec-6c96-4cf9-9b53-c530347d4270 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:38.532090 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-512d53ec-6c96-4cf9-9b53-c530347d4270 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e6942b0c-5931-4573-8310-52a2259db420 HTTP/1.1" status: 204 len: 168 time: 0.5221283 Nov 18 18:24:38.551049 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ddb15dd-12a4-4f85-8c74-f86458171b31 req-db76e114-4b3c-49d3-ba7f-4542d3939d09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:38.552665 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0ddb15dd-12a4-4f85-8c74-f86458171b31 req-db76e114-4b3c-49d3-ba7f-4542d3939d09 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 945 time: 0.2056215 Nov 18 18:24:38.558650 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7c227ca6-3c7d-4aaf-b611-81080d5ce4c8 req-4189e7d0-03c5-43be-af7f-8327e14d138b tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1295786 Nov 18 18:24:38.565572 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-903463d0-700c-4aa6-99aa-bcd5a3286e9f req-b5a02ffa-1157-419f-9ff8-e30045557953 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:38.567319 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-903463d0-700c-4aa6-99aa-bcd5a3286e9f req-b5a02ffa-1157-419f-9ff8-e30045557953 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.2015154 Nov 18 18:24:38.623053 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-512d53ec-6c96-4cf9-9b53-c530347d4270 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6942b0c-5931-4573-8310-52a2259db420,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:38.652977 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b107566-c39e-4a55-8cba-7b370c91a3e9 req-c99a7fe0-9cf7-4fcf-81bb-55a490e59e23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:38.654541 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9b107566-c39e-4a55-8cba-7b370c91a3e9 req-c99a7fe0-9cf7-4fcf-81bb-55a490e59e23 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2650793 Nov 18 18:24:38.662970 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e147fdeb-1568-4328-afd8-6aa73133e4e7 req-12ddbebc-7d9f-4281-b2a5-6a1d846b988b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:38.665253 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e147fdeb-1568-4328-afd8-6aa73133e4e7 req-12ddbebc-7d9f-4281-b2a5-6a1d846b988b service neutron] 10.222.0.31 "GET /v2.0/networks?id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 200 len: 921 time: 0.3300726 Nov 18 18:24:38.734162 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e147fdeb-1568-4328-afd8-6aa73133e4e7 req-b7b51ef5-4eba-418b-85fb-8b31898ca668 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b627bee7-04b0-4a31-8ff0-84f976c65917 HTTP/1.1" status: 200 len: 217 time: 0.0559878 Nov 18 18:24:38.737724 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-86be0f8d-5770-44a5-9bd4-1ae3c70a55fe req-ca6f44d9-8422-4cc4-802f-b8a6898d6c53 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2314956 Nov 18 18:24:38.863591 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-77798d00-5f68-43bb-96a6-c72a10bee9f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:16Z', 'revision_number': 4, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': 'f68ff9ac-17c9-4d9e-b90b-0cf8d3efecc5', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'floating_ip_address': '172.27.1.45', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'port_id': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 370, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'mac_address': 'fa:16:3e:8d:d3:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:24:35Z', 'updated_at': '2021-11-18T18:24:35Z', 'revision_number': 0, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4f9ac680-4b89-4f65-bc06-6239f90f19f3', 'name': '', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'mac_address': 'fa:16:3e:ae:a5:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_interface', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:16Z', 'updated_at': '2021-11-18T18:23:20Z', 'revision_number': 5, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'subnets': [{'id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:24:38.876495 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-903463d0-700c-4aa6-99aa-bcd5a3286e9f req-b208cc32-8e6c-4fc0-99a3-a391b43d9294 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2966378 Nov 18 18:24:38.895331 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77798d00-5f68-43bb-96a6-c72a10bee9f0 None None] The sync data for ids ['0f9804e2-48c3-4648-b16c-33eeec3a9305'] in dv-cinder-787764-6-iscsi is: [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:16Z', 'revision_number': 4, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': 'f68ff9ac-17c9-4d9e-b90b-0cf8d3efecc5', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'floating_ip_address': '172.27.1.45', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'port_id': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 370, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'mac_address': 'fa:16:3e:8d:d3:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:24:35Z', 'updated_at': '2021-11-18T18:24:35Z', 'revision_number': 0, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4f9ac680-4b89-4f65-bc06-6239f90f19f3', 'name': '', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'mac_address': 'fa:16:3e:ae:a5:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_interface', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:16Z', 'updated_at': '2021-11-18T18:23:20Z', 'revision_number': 5, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'subnets': [{'id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:24:38.917972 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8da6c573-7854-40b0-8085-aa008e0dff94 req-810c10a7-d177-4b6d-88eb-cbbd7af1969c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:38.925678 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8da6c573-7854-40b0-8085-aa008e0dff94 req-810c10a7-d177-4b6d-88eb-cbbd7af1969c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 946 time: 0.1846323 Nov 18 18:24:38.940858 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9b107566-c39e-4a55-8cba-7b370c91a3e9 req-b51c6a2c-c676-40a4-b118-b3ee33575368 service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2606280 Nov 18 18:24:38.991766 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-0ddb15dd-12a4-4f85-8c74-f86458171b31 req-30a055d5-2bc8-4f92-9d62-5c4b73c0f632 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Deleting port f3483de4-481b-47ac-8d51-f8457fd0bb85 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:24:38.992050 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0ddb15dd-12a4-4f85-8c74-f86458171b31 req-30a055d5-2bc8-4f92-9d62-5c4b73c0f632 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:39.004830 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e147fdeb-1568-4328-afd8-6aa73133e4e7 req-d268ebb9-a095-4e7e-b147-88d35d7c6976 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:39.006913 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e147fdeb-1568-4328-afd8-6aa73133e4e7 req-d268ebb9-a095-4e7e-b147-88d35d7c6976 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 HTTP/1.1" status: 200 len: 859 time: 0.0625196 Nov 18 18:24:39.048625 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:39.051774 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e147fdeb-1568-4328-afd8-6aa73133e4e7 req-3cdc4780-0579-4734-bfb5-42b8114ab036 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0364144 Nov 18 18:24:39.114177 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8da6c573-7854-40b0-8085-aa008e0dff94 req-4b745fa6-0f86-4cbd-8034-c0cba42a942f tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1875811 Nov 18 18:24:39.159291 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71368ffa-6ff9-43a4-9466-f36392396855 None None] New status for floating IP f68ff9ac-17c9-4d9e-b90b-0cf8d3efecc5: ACTIVE {{(pid=102690) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:24:39.164151 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9b107566-c39e-4a55-8cba-7b370c91a3e9 req-d07b5732-5c3f-431c-b1f7-a2db9f02857c service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2036839 Nov 18 18:24:39.171048 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-0ddb15dd-12a4-4f85-8c74-f86458171b31 req-30a055d5-2bc8-4f92-9d62-5c4b73c0f632 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] For port f3483de4-481b-47ac-8d51-f8457fd0bb85, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f3483de4-481b-47ac-8d51-f8457fd0bb85,segment=NetworkSegment(2ba9981f-6a4d-4618-9c8c-84315de87d1c),segment_id=2ba9981f-6a4d-4618-9c8c-84315de87d1c)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:24:39.171608 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0ddb15dd-12a4-4f85-8c74-f86458171b31 req-30a055d5-2bc8-4f92-9d62-5c4b73c0f632 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:39.176571 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e147fdeb-1568-4328-afd8-6aa73133e4e7 req-3dc9751d-bb2c-4f86-8bc1-43307f6ed213 service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1100931 Nov 18 18:24:39.185663 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-0ddb15dd-12a4-4f85-8c74-f86458171b31 req-30a055d5-2bc8-4f92-9d62-5c4b73c0f632 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Calling delete_port for f3483de4-481b-47ac-8d51-f8457fd0bb85 owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:24:39.296770 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f2f1ef3-1516-4caa-a87a-bbb4b9cd4628 req-d6a6992a-5e07-4ec9-a25f-a0bd2525ddb1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:39.298504 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6f2f1ef3-1516-4caa-a87a-bbb4b9cd4628 req-d6a6992a-5e07-4ec9-a25f-a0bd2525ddb1 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/ports?device_id=d97cfd7c-ce26-40fe-858c-abdf67b8024a HTTP/1.1" status: 200 len: 945 time: 0.0651484 Nov 18 18:24:39.302291 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e147fdeb-1568-4328-afd8-6aa73133e4e7 req-bf242aa5-6067-4bf2-aa08-25eb387996df service neutron] 10.222.0.31 "GET /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0964799 Nov 18 18:24:39.388229 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6f2f1ef3-1516-4caa-a87a-bbb4b9cd4628 req-c968a459-4e38-4168-8be4-d5404437c2ec tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.82 "GET /v2.0/security-groups?id=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0802202 Nov 18 18:24:39.411450 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0ddb15dd-12a4-4f85-8c74-f86458171b31 req-30a055d5-2bc8-4f92-9d62-5c4b73c0f632 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:39.423692 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['f3483de4-481b-47ac-8d51-f8457fd0bb85'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:24:39.442099 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a055d5-2bc8-4f92-9d62-5c4b73c0f632 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Pushing event deleted for resources: {'Port': ['ID=f3483de4-481b-47ac-8d51-f8457fd0bb85,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:39.481271 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-0ddb15dd-12a4-4f85-8c74-f86458171b31 req-30a055d5-2bc8-4f92-9d62-5c4b73c0f632 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] No DVR routers for this DVR port f3483de4-481b-47ac-8d51-f8457fd0bb85 on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:24:39.483711 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-0ddb15dd-12a4-4f85-8c74-f86458171b31 req-30a055d5-2bc8-4f92-9d62-5c4b73c0f632 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:39.487179 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0ddb15dd-12a4-4f85-8c74-f86458171b31 req-30a055d5-2bc8-4f92-9d62-5c4b73c0f632 tempest-AttachVolumeNegativeTest-878182438 tempest-AttachVolumeNegativeTest-878182438-project] 10.222.0.31 "DELETE /v2.0/ports/f3483de4-481b-47ac-8d51-f8457fd0bb85 HTTP/1.1" status: 204 len: 173 time: 0.9158390 Nov 18 18:24:39.687429 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd97cfd7c-ce26-40fe-858c-abdf67b8024a', 'name': 'network-vif-deleted', 'tag': 'f3483de4-481b-47ac-8d51-f8457fd0bb85'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:24:39.689874 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-581c3161-3e67-4bfb-876f-73b69173271f" -d '{"events": [{"server_uuid": "d97cfd7c-ce26-40fe-858c-abdf67b8024a", "name": "network-vif-deleted", "tag": "f3483de4-481b-47ac-8d51-f8457fd0bb85"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:24:39.710731 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-072cd7ac-c95e-4975-8a30-6d14fa82c14b req-e00a99e3-7757-4316-ac63-62a055c1cfb7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:39.716455 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-072cd7ac-c95e-4975-8a30-6d14fa82c14b req-e00a99e3-7757-4316-ac63-62a055c1cfb7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0674818 Nov 18 18:24:39.740459 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:24:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-83e59486-29b1-4b69-b0b0-6d8a7c7725b6 x-openstack-request-id: req-83e59486-29b1-4b69-b0b0-6d8a7c7725b6 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:24:39.740858 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d97cfd7c-ce26-40fe-858c-abdf67b8024a", "name": "network-vif-deleted", "tag": "f3483de4-481b-47ac-8d51-f8457fd0bb85", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:24:39.741180 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-83e59486-29b1-4b69-b0b0-6d8a7c7725b6 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:24:39.741588 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd97cfd7c-ce26-40fe-858c-abdf67b8024a', 'name': 'network-vif-deleted', 'tag': 'f3483de4-481b-47ac-8d51-f8457fd0bb85', 'status': 'completed', 'code': 200} Nov 18 18:24:39.765893 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-072cd7ac-c95e-4975-8a30-6d14fa82c14b req-466c0d59-6fc8-4d1c-b06b-5f19e169c0c0 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468905 Nov 18 18:24:40.066341 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e5056b2-d8eb-4f18-9bbe-9edb1bfefb63 req-4edd8bb3-17ac-4ed4-b343-7432494facd3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:40.068176 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5e5056b2-d8eb-4f18-9bbe-9edb1bfefb63 req-4edd8bb3-17ac-4ed4-b343-7432494facd3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0534167 Nov 18 18:24:40.106798 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:24:40.109134 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2197a85b-5b79-4959-bdad-3b02818fde94" -d '{"events": [{"server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "name": "network-vif-unplugged", "status": "completed", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:24:40.121651 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5e5056b2-d8eb-4f18-9bbe-9edb1bfefb63 req-5e58271f-e05e-4b1c-89be-9583e3de6db7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463960 Nov 18 18:24:40.142927 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 18 Nov 2021 18:24:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-470d9b32-39c6-40f0-bd7a-3cf029f6dfda x-openstack-request-id: req-470d9b32-39c6-40f0-bd7a-3cf029f6dfda {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:24:40.143236 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "name": "network-vif-unplugged", "status": "failed", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d", "code": 422}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:24:40.143534 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-470d9b32-39c6-40f0-bd7a-3cf029f6dfda {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:24:40.143964 dv-cinder-787764-6-iscsi neutron-server[102690]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'code': 422} returned with failed status Nov 18 18:24:40.175742 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:40.249556 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e323b43-ade1-4095-881d-6ee7a627b9d9 req-a068c7d0-d369-4706-afbb-892a91c2474e tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:40.251079 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2e323b43-ade1-4095-881d-6ee7a627b9d9 req-a068c7d0-d369-4706-afbb-892a91c2474e tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 946 time: 0.0587015 Nov 18 18:24:40.307116 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2e323b43-ade1-4095-881d-6ee7a627b9d9 req-0d7f43ab-f36f-42b8-96b0-3365e4da5828 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491459 Nov 18 18:24:40.447468 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 40824) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:40.493340 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_v2 [None req-5e311195-9cae-4182-ad1f-da2b9095ff2a admin admin] Deleting subnet 488ef4e4-e6f9-414a-b93f-aabd7b232f9e {{(pid=102689) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:24:40.496471 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5e311195-9cae-4182-ad1f-da2b9095ff2a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:40.531061 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5e311195-9cae-4182-ad1f-da2b9095ff2a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12724830'] for subnet, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:40.569103 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5e311195-9cae-4182-ad1f-da2b9095ff2a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:40.617131 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [req-44171d05-7ce0-4373-9a17-b31e2059e728 req-523da8b8-dd16-455d-b675-9c916715a10a service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:24:40.618093 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-44171d05-7ce0-4373-9a17-b31e2059e728 req-523da8b8-dd16-455d-b675-9c916715a10a service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0056126 Nov 18 18:24:40.625319 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5e311195-9cae-4182-ad1f-da2b9095ff2a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12723963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14479099'] for subnet, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:40.654991 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e311195-9cae-4182-ad1f-da2b9095ff2a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=488ef4e4-e6f9-414a-b93f-aabd7b232f9e,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:40.658650 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5e311195-9cae-4182-ad1f-da2b9095ff2a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:40.662141 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-5e311195-9cae-4182-ad1f-da2b9095ff2a admin admin] 10.222.0.82 "DELETE /v2.0/subnets/488ef4e4-e6f9-414a-b93f-aabd7b232f9e HTTP/1.1" status: 204 len: 168 time: 0.2132165 Nov 18 18:24:40.664553 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 40832) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:40.745298 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:40.829274 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f657830-da6e-448f-a089-fafe1af88324 req-14c2e929-94e2-4771-8e05-982482e673fc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:40.831016 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8f657830-da6e-448f-a089-fafe1af88324 req-14c2e929-94e2-4771-8e05-982482e673fc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.1006734 Nov 18 18:24:40.887152 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:40.941050 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['14ac84aa-8c04-4323-8592-aecfbb5a7fe1']}} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:24:40.967840 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2ba9981f-6a4d-4618-9c8c-84315de87d1c') {'for_net_delete': True} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:24:40.968163 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2ba9981f-6a4d-4618-9c8c-84315de87d1c') {} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:24:40.982792 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8f657830-da6e-448f-a089-fafe1af88324 req-d3ea8464-8865-44fa-b40e-0e8bd0f73110 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1368103 Nov 18 18:24:40.984492 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12724807'] for segment, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:40.993570 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b797b8f-af64-4f6f-bad5-6114b03d2de0 req-6376e6a5-6964-459c-8ba0-3d10e5407437 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:40.995041 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7b797b8f-af64-4f6f-bad5-6114b03d2de0 req-6376e6a5-6964-459c-8ba0-3d10e5407437 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1514881 Nov 18 18:24:41.012010 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:41.026023 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] Releasing vlan 1303 on physical network physnet1 to pool {{(pid=102689) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:24:41.026398 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12723877'] for segment, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: Traceback (most recent call last): Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: timer() Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: cb(*args, **kw) Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: return func(*args, **kwargs) Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: self._notify() Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: self.callback(batched_events) Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: event.method(event) Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: return f(self, *a, **k) Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._get(url).json() Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: return self.request(url, 'GET', **kwargs) Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:24:41.028104 dv-cinder-787764-6-iscsi neutron-server[102689]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:24:41.096869 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7b797b8f-af64-4f6f-bad5-6114b03d2de0 req-108cf07f-1087-493e-8edc-e4b372d86ef3 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0921960 Nov 18 18:24:41.101151 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:41.108425 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:41.111613 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] 10.222.0.82 "DELETE /v2.0/networks/14ac84aa-8c04-4323-8592-aecfbb5a7fe1 HTTP/1.1" status: 204 len: 168 time: 0.4461458 Nov 18 18:24:41.121918 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c585f84-59d0-4eaf-86fb-0bb998090be7 admin admin] Pushing event deleted for resources: {'Network': ['ID=14ac84aa-8c04-4323-8592-aecfbb5a7fe1,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:41.190486 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 40864) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:41.278014 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18038425-e527-48a8-820f-b14cc73597b1 req-33696489-2a9b-448a-b83a-6945354f36c5 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0860963 Nov 18 18:24:41.288006 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [req-18038425-e527-48a8-820f-b14cc73597b1 req-b4eb0428-ce85-4f97-a4db-31330a975396 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:24:41.288653 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 40868) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:41.289272 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18038425-e527-48a8-820f-b14cc73597b1 req-b4eb0428-ce85-4f97-a4db-31330a975396 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0060213 Nov 18 18:24:41.327699 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-513a30ed-7e89-4bd7-b56d-0f4818be34fd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=eed6400cd0414bc5a520c9886c2a4bde&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0377457 Nov 18 18:24:41.330123 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 40874) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:41.384428 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-54824b43-67b3-4337-9102-edfaea9807a6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:41.410357 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-54824b43-67b3-4337-9102-edfaea9807a6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:41.476148 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-54824b43-67b3-4337-9102-edfaea9807a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:41.479711 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-54824b43-67b3-4337-9102-edfaea9807a6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:41.481530 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-54824b43-67b3-4337-9102-edfaea9807a6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8 HTTP/1.1" status: 204 len: 168 time: 0.1505027 Nov 18 18:24:41.491196 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54824b43-67b3-4337-9102-edfaea9807a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3f520bf-caa4-40f8-b5f7-1ac2c14c29c8,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:41.539451 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b8ded38f-97b4-485b-9845-705c1fb9701d no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:24:41.655577 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device f3483de4-481b-47ac-8d51-f8457fd0bb85 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:24:41.658772 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbcfe06c-6235-43cf-ba5d-37c9aaf9eb7b req-e0f4dead-673b-46e0-bbb4-8cebb468b0be tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:41.667530 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dbcfe06c-6235-43cf-ba5d-37c9aaf9eb7b req-e0f4dead-673b-46e0-bbb4-8cebb468b0be tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 946 time: 0.2879534 Nov 18 18:24:41.699626 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: f3483de4-481b-47ac-8d51-f8457fd0bb85 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:24:41.700325 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device f3483de4-481b-47ac-8d51-f8457fd0bb85 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:24:41.722873 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dbcfe06c-6235-43cf-ba5d-37c9aaf9eb7b req-550e3512-3202-451c-a102-e316fe4d1a00 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540466 Nov 18 18:24:41.847225 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff58f310-dd42-4bc9-9dc1-d740328d0cfa req-7ed7683e-38d5-42f6-baed-9ea75a2ebbae tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:41.848779 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ff58f310-dd42-4bc9-9dc1-d740328d0cfa req-7ed7683e-38d5-42f6-baed-9ea75a2ebbae tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 946 time: 0.0498931 Nov 18 18:24:41.898717 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ff58f310-dd42-4bc9-9dc1-d740328d0cfa req-4fcda7ef-f5d4-4c03-950e-1cb84723b7dc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439582 Nov 18 18:24:42.166704 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec812618-faee-471d-a59b-6f38c67741ec req-08095b16-1816-4067-a79b-d267dc4a72ef tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:42.168287 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ec812618-faee-471d-a59b-6f38c67741ec req-08095b16-1816-4067-a79b-d267dc4a72ef tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0917587 Nov 18 18:24:42.240936 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ec812618-faee-471d-a59b-6f38c67741ec req-826d9468-57b7-4d30-bc7d-6daf322c38c2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0656118 Nov 18 18:24:42.261926 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-202cf548-d7d2-449a-8263-5a7d994d37e8 req-34a05b0b-85d2-47b4-b176-66d462600468 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:42.263442 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-202cf548-d7d2-449a-8263-5a7d994d37e8 req-34a05b0b-85d2-47b4-b176-66d462600468 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0620248 Nov 18 18:24:42.326607 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-202cf548-d7d2-449a-8263-5a7d994d37e8 req-2a092aa5-a5e5-43c0-9e77-40171632e6f7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561826 Nov 18 18:24:42.363278 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9af49e8-cc78-4bfc-aa89-58c2e57ccfa1 req-bcc32b08-71db-4530-a564-86a020a586f6 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:42.364822 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a9af49e8-cc78-4bfc-aa89-58c2e57ccfa1 req-bcc32b08-71db-4530-a564-86a020a586f6 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 946 time: 0.0542495 Nov 18 18:24:42.423055 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a9af49e8-cc78-4bfc-aa89-58c2e57ccfa1 req-79a5626d-993b-4a04-9de8-0071b693f336 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513837 Nov 18 18:24:43.364184 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5654169-5f76-4cc4-aa32-6ccd20f0eedc req-3aa22d6c-4404-4b7f-8c61-639455dd0e9b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:43.365707 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f5654169-5f76-4cc4-aa32-6ccd20f0eedc req-3aa22d6c-4404-4b7f-8c61-639455dd0e9b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0494871 Nov 18 18:24:43.446736 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 40954) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:43.464237 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f5654169-5f76-4cc4-aa32-6ccd20f0eedc req-bb560b5c-3d82-4681-8904-969133d93cb4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0926201 Nov 18 18:24:43.476390 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18038425-e527-48a8-820f-b14cc73597b1 req-be251563-8cbd-46bd-9e12-1207b9b8592f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:43.477868 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18038425-e527-48a8-820f-b14cc73597b1 req-be251563-8cbd-46bd-9e12-1207b9b8592f service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb&tenant_id=6a79674a70ee4ad7acedc7d4896b413e HTTP/1.1" status: 200 len: 1096 time: 0.0874457 Nov 18 18:24:43.554149 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5c0cc3f-cc94-430c-bb67-4e857672644c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:43.555828 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18038425-e527-48a8-820f-b14cc73597b1 req-cc40f5cb-1993-44ad-9f1a-5ffc4968c55d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:43.557437 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18038425-e527-48a8-820f-b14cc73597b1 req-cc40f5cb-1993-44ad-9f1a-5ffc4968c55d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 1096 time: 0.0473893 Nov 18 18:24:43.631535 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5c0cc3f-cc94-430c-bb67-4e857672644c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:43.636278 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5c0cc3f-cc94-430c-bb67-4e857672644c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:43.660326 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18038425-e527-48a8-820f-b14cc73597b1 req-3f0cd2a5-7747-4922-a293-1fc4560eba72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:43.661825 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18038425-e527-48a8-820f-b14cc73597b1 req-3f0cd2a5-7747-4922-a293-1fc4560eba72 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 919 time: 0.0903721 Nov 18 18:24:43.673644 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a5c0cc3f-cc94-430c-bb67-4e857672644c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=61b59d982a894d6b8e0af1b77379cb23&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2255561 Nov 18 18:24:43.675588 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c0cc3f-cc94-430c-bb67-4e857672644c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac786288-d134-4def-b54c-7085222d2594,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:43.676174 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 40958) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:43.762157 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18038425-e527-48a8-820f-b14cc73597b1 req-101c495f-99bb-4fc0-a78f-a8bbd6f66d96 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b8ded38f-97b4-485b-9845-705c1fb9701d HTTP/1.1" status: 200 len: 999 time: 0.0929611 Nov 18 18:24:43.771518 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a4b1e34b-e750-45e6-932e-6fce42066837 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:43.823315 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a4b1e34b-e750-45e6-932e-6fce42066837 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:43.853104 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18038425-e527-48a8-820f-b14cc73597b1 req-c377631d-f28f-47d0-991c-9efe9e71eca5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:43.854614 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18038425-e527-48a8-820f-b14cc73597b1 req-c377631d-f28f-47d0-991c-9efe9e71eca5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 200 len: 856 time: 0.0786982 Nov 18 18:24:43.910513 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18038425-e527-48a8-820f-b14cc73597b1 req-e364d253-ce71-4051-bd5c-b1a7b958c118 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:43.912812 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18038425-e527-48a8-820f-b14cc73597b1 req-e364d253-ce71-4051-bd5c-b1a7b958c118 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d845755f-6a59-4935-8123-1a70c6e45968&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0486350 Nov 18 18:24:43.913722 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a4b1e34b-e750-45e6-932e-6fce42066837 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:43.916345 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a4b1e34b-e750-45e6-932e-6fce42066837 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:43.917369 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-a4b1e34b-e750-45e6-932e-6fce42066837 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ac786288-d134-4def-b54c-7085222d2594 HTTP/1.1" status: 204 len: 168 time: 0.2403219 Nov 18 18:24:43.932997 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b1e34b-e750-45e6-932e-6fce42066837 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac786288-d134-4def-b54c-7085222d2594,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:44.029558 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18038425-e527-48a8-820f-b14cc73597b1 req-9e4bdb7d-d15e-4422-8c74-3fabc9e87f0e service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1042457 Nov 18 18:24:44.159222 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18038425-e527-48a8-820f-b14cc73597b1 req-c6b4f20d-3362-4325-b67c-982b28bf2a70 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1179204 Nov 18 18:24:44.637661 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109818e8-3479-4b0d-810b-c175359989c2 req-0da902da-5087-45d9-9739-7bc6a6c7d12b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:44.639333 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-109818e8-3479-4b0d-810b-c175359989c2 req-0da902da-5087-45d9-9739-7bc6a6c7d12b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0717981 Nov 18 18:24:44.691807 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-109818e8-3479-4b0d-810b-c175359989c2 req-9198c06f-3dca-4086-be02-463d36639cbf tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456076 Nov 18 18:24:44.805529 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41052) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:44.957512 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1292900904-network', 'tenant_id': 'c9e6e099470048148cdcfa828b9a32ea'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:24:44.978819 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Made reservation on behalf of c9e6e099470048148cdcfa828b9a32ea for: {'network': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:24:44.981188 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:44.989398 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:45.067184 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:45.070673 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:45.094758 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1322} {{(pid=102689) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:24:45.104988 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5db6b05a-02c4-413e-92b0-d64c41b76294,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:45.110443 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:45.110776 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.segments_db [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Added segment 6f13a496-1ac6-44ee-a618-9dee39276ca6 of type vlan for network 33a318b5-ad11-45c7-9380-7c9c44d250de Nov 18 18:24:45.152682 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:45.176545 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:45.177488 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:45.178130 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:45.210850 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.4041324 Nov 18 18:24:45.213869 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41056) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:45.219612 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-f2d81471-97f3-4d95-8530-1dc91c3b76df admin admin] Request body: {'subnet': {'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1292900904-subnet', 'tenant_id': 'c9e6e099470048148cdcfa828b9a32ea', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:24:45.240008 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b1c9a98-72f2-4800-ba21-a7e7e15aa13c admin admin] Pushing event updated for resources: {'Network': ['ID=33a318b5-ad11-45c7-9380-7c9c44d250de,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:45.241247 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f2d81471-97f3-4d95-8530-1dc91c3b76df admin admin] Made reservation on behalf of c9e6e099470048148cdcfa828b9a32ea for: {'subnet': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:24:45.243846 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f2d81471-97f3-4d95-8530-1dc91c3b76df admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14505870'] for subnet, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:45.253591 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network 33a318b5-ad11-45c7-9380-7c9c44d250de details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:24:45.416033 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f2d81471-97f3-4d95-8530-1dc91c3b76df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-13993069', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14505888'] for subnet, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:45.475478 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d81471-97f3-4d95-8530-1dc91c3b76df admin admin] Pushing event updated for resources: {'Subnet': ['ID=15a76039-95a8-4c78-b321-326b06094f8d,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:45.483834 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f2d81471-97f3-4d95-8530-1dc91c3b76df admin admin] Checking segment: {'id': '6f13a496-1ac6-44ee-a618-9dee39276ca6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:24:45.484223 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2d81471-97f3-4d95-8530-1dc91c3b76df admin admin] Network hostable DHCP agents. Network: 33a318b5-ad11-45c7-9380-7c9c44d250de, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102688) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:24:45.500497 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2d81471-97f3-4d95-8530-1dc91c3b76df admin admin] Network 33a318b5-ad11-45c7-9380-7c9c44d250de is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102688) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:24:45.509143 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-f2d81471-97f3-4d95-8530-1dc91c3b76df admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, 33a318b5-ad11-45c7-9380-7c9c44d250de) {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:24:45.513837 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2d81471-97f3-4d95-8530-1dc91c3b76df admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:45.514718 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f2d81471-97f3-4d95-8530-1dc91c3b76df admin admin] Publish callbacks [] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:45.518083 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9fa9e6c-6d2b-4206-8fa7-b2fc5005e59f None None] Network 33a318b5-ad11-45c7-9380-7c9c44d250de requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:24:45.530618 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-f2d81471-97f3-4d95-8530-1dc91c3b76df admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3147538 Nov 18 18:24:45.655426 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb25e053-004a-49f8-aca4-29d7c887996e None None] Network 33a318b5-ad11-45c7-9380-7c9c44d250de requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:24:45.826062 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40326a28-b15f-4b22-8b0a-62457c3adf15 req-2f745173-ceda-4942-9b5a-df62debcb955 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:45.827583 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-40326a28-b15f-4b22-8b0a-62457c3adf15 req-2f745173-ceda-4942-9b5a-df62debcb955 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0515842 Nov 18 18:24:45.875337 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-40326a28-b15f-4b22-8b0a-62457c3adf15 req-6bb77071-f3aa-4fc4-bb65-67d63b892db6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417418 Nov 18 18:24:46.997246 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9710d9-7c32-4450-bf6a-61e4a7572efc req-0f6174af-b33e-4418-9e2f-27516dda2756 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:46.999781 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-af9710d9-7c32-4450-bf6a-61e4a7572efc req-0f6174af-b33e-4418-9e2f-27516dda2756 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0495594 Nov 18 18:24:47.049501 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-af9710d9-7c32-4450-bf6a-61e4a7572efc req-15d99023-d1fc-46cc-bf90-d8eb96d288eb tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449400 Nov 18 18:24:48.175574 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6b6ea39-3cb0-491c-b641-600998d7de50 req-e00ae015-2f9e-45b6-a59c-d547a3b15503 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:48.177094 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c6b6ea39-3cb0-491c-b641-600998d7de50 req-e00ae015-2f9e-45b6-a59c-d547a3b15503 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0513141 Nov 18 18:24:48.229777 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c6b6ea39-3cb0-491c-b641-600998d7de50 req-d77588ef-8f98-4f5c-b01b-dacb61a8915d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468144 Nov 18 18:24:49.435810 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb582ce7-b92a-4150-99e9-1fbfc0718e62 req-06b7eb2c-2af8-4ffa-94a3-3b7b5c263077 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:49.437315 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bb582ce7-b92a-4150-99e9-1fbfc0718e62 req-06b7eb2c-2af8-4ffa-94a3-3b7b5c263077 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.1172504 Nov 18 18:24:49.460249 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-2ce1ea5f-7a54-485f-822c-1033aba75abb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:49.462727 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-2ce1ea5f-7a54-485f-822c-1033aba75abb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/networks?id=33a318b5-ad11-45c7-9380-7c9c44d250de HTTP/1.1" status: 200 len: 814 time: 0.1521511 Nov 18 18:24:49.486547 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-82019664-3ce6-4be6-88ef-68f7463391ab tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/quotas/c9e6e099470048148cdcfa828b9a32ea HTTP/1.1" status: 200 len: 375 time: 0.0157897 Nov 18 18:24:49.525609 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-84262f9e-90f7-4b84-b2a4-87638df0faf9 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=c9e6e099470048148cdcfa828b9a32ea&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0334120 Nov 18 18:24:49.530537 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bb582ce7-b92a-4150-99e9-1fbfc0718e62 req-79e1c988-1c2a-4771-84ff-99663df8a1bf tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0858819 Nov 18 18:24:49.625240 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6256b865-77a3-4327-9d08-787ed14b2dd9 service neutron] 10.222.0.82 "GET /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0919468 Nov 18 18:24:49.723803 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-d2a99d1a-27a9-4413-b20a-2c22c405c508 service neutron] 10.222.0.82 "GET /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0915301 Nov 18 18:24:49.793209 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e07ae1-3a24-4a01-baf6-1a3b6c703eda req-919b6ed9-6794-4b16-b898-fbd59a35c4cc tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:49.794919 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-60e07ae1-3a24-4a01-baf6-1a3b6c703eda req-919b6ed9-6794-4b16-b898-fbd59a35c4cc tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0653746 Nov 18 18:24:49.871849 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-60e07ae1-3a24-4a01-baf6-1a3b6c703eda req-e048807b-900f-44cf-9160-b00b93ca363c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704410 Nov 18 18:24:49.976119 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c6f3a183-b523-43a7-9e41-f5568b3fbef2 req-9ff2f447-8137-417a-952a-b75756791a68 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0376194 Nov 18 18:24:50.653921 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e3f1f68-85f3-4ce9-a197-cd21bcf0db2f req-811bb732-09e2-4148-a33b-e31b91c79dd2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:50.655720 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7e3f1f68-85f3-4ce9-a197-cd21bcf0db2f req-811bb732-09e2-4148-a33b-e31b91c79dd2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0503075 Nov 18 18:24:50.704101 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7e3f1f68-85f3-4ce9-a197-cd21bcf0db2f req-50cc828e-7b12-4142-bd37-7650d9f118f3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422764 Nov 18 18:24:50.999173 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb644ef7-5494-4b54-bb7d-7035ac03075a req-431cdfd3-2e19-4fc2-8234-caf3f3b8939a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:51.001064 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bb644ef7-5494-4b54-bb7d-7035ac03075a req-431cdfd3-2e19-4fc2-8234-caf3f3b8939a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0516052 Nov 18 18:24:51.053235 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bb644ef7-5494-4b54-bb7d-7035ac03075a req-8c0ccd07-a819-45b9-b83c-019234bb77c6 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461259 Nov 18 18:24:51.083364 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-df9f091a-5690-4eb5-83b3-aec154884b9c req-bd4aea66-9f28-4149-8b6f-a634c920f40e tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0290747 Nov 18 18:24:51.139604 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:51.416123 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41196) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:51.529883 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-86807f95-36a1-4fdd-866a-a911bec8c89f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:51.608324 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-86807f95-36a1-4fdd-866a-a911bec8c89f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:51.612577 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-86807f95-36a1-4fdd-866a-a911bec8c89f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:51.650880 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-86807f95-36a1-4fdd-866a-a911bec8c89f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9ee9b5fdf3f744a2aec08d01c4a8ef3b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2336583 Nov 18 18:24:51.654039 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41200) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:51.657110 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86807f95-36a1-4fdd-866a-a911bec8c89f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=db7c68be-a7b7-4ccb-a334-09a9e97065c2,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:51.704481 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc474186-5f76-4681-a5e2-82296a2ed5ca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:51.727584 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc474186-5f76-4681-a5e2-82296a2ed5ca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:51.792471 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc474186-5f76-4681-a5e2-82296a2ed5ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:51.795178 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc474186-5f76-4681-a5e2-82296a2ed5ca admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:51.796320 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-bc474186-5f76-4681-a5e2-82296a2ed5ca admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/db7c68be-a7b7-4ccb-a334-09a9e97065c2 HTTP/1.1" status: 204 len: 168 time: 0.1413047 Nov 18 18:24:51.825326 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc474186-5f76-4681-a5e2-82296a2ed5ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=db7c68be-a7b7-4ccb-a334-09a9e97065c2,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:51.867120 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9339cbbd-352e-4144-a9df-a62945eeceb5 req-17787354-1a23-4a6a-adaa-259b3eb0c62e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:51.868809 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9339cbbd-352e-4144-a9df-a62945eeceb5 req-17787354-1a23-4a6a-adaa-259b3eb0c62e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0777812 Nov 18 18:24:51.971867 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9339cbbd-352e-4144-a9df-a62945eeceb5 req-268570ef-c254-46b1-9285-ea9f0b0ec0f9 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0921643 Nov 18 18:24:52.204587 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9cd4609c-82b7-44c6-a221-2c8d0cb93ac6 req-1bec8b86-8954-467f-aa5f-958b542192fe tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0293729 Nov 18 18:24:52.225949 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74a57827-b12f-4e9b-abb6-759c57382ca2 req-2eaef22b-5e1c-4a5d-ae51-5a6a63c31306 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:52.227799 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-74a57827-b12f-4e9b-abb6-759c57382ca2 req-2eaef22b-5e1c-4a5d-ae51-5a6a63c31306 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0876253 Nov 18 18:24:52.293290 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-74a57827-b12f-4e9b-abb6-759c57382ca2 req-34158be8-6e2a-49e2-af1f-d2f01365962a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543644 Nov 18 18:24:53.129940 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91edf40-e319-4d89-a9c6-c18cde725d37 req-41e80f9f-2252-4b00-a81c-e2ed0eeea8d8 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:53.132745 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a91edf40-e319-4d89-a9c6-c18cde725d37 req-41e80f9f-2252-4b00-a81c-e2ed0eeea8d8 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0534110 Nov 18 18:24:53.214633 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a91edf40-e319-4d89-a9c6-c18cde725d37 req-5ca2cab3-afda-439d-be3c-fe5cff11a65c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0736523 Nov 18 18:24:53.302533 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-056a2dcd-1ed7-490e-a660-50457ad2a985 req-85be3bd6-058e-473f-b94e-79b89008179e tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0267124 Nov 18 18:24:53.399549 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae734d29-3ca1-466d-818d-671aa0372fb2 req-cac47194-b9e2-432c-a7e2-89ad7f473b9e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:53.401133 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae734d29-3ca1-466d-818d-671aa0372fb2 req-cac47194-b9e2-432c-a7e2-89ad7f473b9e tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0494378 Nov 18 18:24:53.459896 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ae734d29-3ca1-466d-818d-671aa0372fb2 req-c0f86179-2aeb-4161-9706-0b261d9ce647 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526659 Nov 18 18:24:54.338812 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a538881-5312-443a-be1c-88e0497a852f req-91bad2c3-742f-4cef-bf15-45b9e7ea04a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:54.340718 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a538881-5312-443a-be1c-88e0497a852f req-91bad2c3-742f-4cef-bf15-45b9e7ea04a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0497742 Nov 18 18:24:54.409674 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b2c5c8d7-850a-4270-80c4-f04819829f3c req-b369d847-06d8-40d9-976f-9626fb24c1df tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0382180 Nov 18 18:24:54.414609 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a538881-5312-443a-be1c-88e0497a852f req-9f08925d-83a2-4d3b-8a34-12ccb2223d2c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0670907 Nov 18 18:24:54.572929 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e14aaf22-7b1a-4616-b853-23e02ca13dd1 req-18444a36-1274-45c9-81ee-daba35039fba tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:54.574401 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e14aaf22-7b1a-4616-b853-23e02ca13dd1 req-18444a36-1274-45c9-81ee-daba35039fba tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0480461 Nov 18 18:24:54.621709 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e14aaf22-7b1a-4616-b853-23e02ca13dd1 req-b0db883a-a5cd-40f4-97d9-83967a8ca106 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412939 Nov 18 18:24:55.514871 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e31fe5aa-d01e-4cc2-b9bb-53bc9a83b195 req-33d16a2e-eee2-4ca7-a81a-2478fae25c16 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0351398 Nov 18 18:24:55.557328 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c23b96b8-0b03-4a90-96c5-b851262053db req-05fa218a-8159-4b13-9d9e-2510dd5ad431 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:55.558818 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c23b96b8-0b03-4a90-96c5-b851262053db req-05fa218a-8159-4b13-9d9e-2510dd5ad431 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0661774 Nov 18 18:24:55.606282 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c23b96b8-0b03-4a90-96c5-b851262053db req-aa49ba54-1497-43d1-b7b0-1b3483e28dee tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415139 Nov 18 18:24:55.735738 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-825d0966-665a-479d-8a27-2d89723711ab req-72c21a7d-e40e-4ce0-aeb2-8e86e491d6fc tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:55.737156 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-825d0966-665a-479d-8a27-2d89723711ab req-72c21a7d-e40e-4ce0-aeb2-8e86e491d6fc tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0489407 Nov 18 18:24:55.787685 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-825d0966-665a-479d-8a27-2d89723711ab req-25663713-1f3d-4b52-b08d-b7ac06587e35 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433795 Nov 18 18:24:56.608213 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2452fbab-0ead-406c-8de5-181d83820611 req-51463e7e-ad94-48db-be56-3b3fb03cac81 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0257757 Nov 18 18:24:56.748722 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292a4a0a-b082-44aa-953e-566ec3b06348 req-c7495f85-fbf2-4689-a0d5-92933ffed1d7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:56.750207 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-292a4a0a-b082-44aa-953e-566ec3b06348 req-c7495f85-fbf2-4689-a0d5-92933ffed1d7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0575068 Nov 18 18:24:56.797723 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-292a4a0a-b082-44aa-953e-566ec3b06348 req-b5d76c90-3ade-4ecc-97a5-37f1b98ca380 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411882 Nov 18 18:24:56.913031 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc91144-2d26-4590-b024-eb47f1e4b08e req-735c55d6-2599-4ccb-b6dc-12d2d0ec7807 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:56.914547 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7cc91144-2d26-4590-b024-eb47f1e4b08e req-735c55d6-2599-4ccb-b6dc-12d2d0ec7807 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0502491 Nov 18 18:24:56.969555 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7cc91144-2d26-4590-b024-eb47f1e4b08e req-a62a7eec-f45f-4f7a-9257-bdd7c52abfb7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487714 Nov 18 18:24:57.705957 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eb788b17-e3b0-47e0-adf4-89fba5498edd req-98ca7e00-8674-43de-8aff-b59e7d7f2907 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0286593 Nov 18 18:24:57.924799 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ebfb07a-437e-4417-bc86-c23ad58946ae req-20b31241-0539-44e3-b20a-f37e5720488d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:57.926187 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1ebfb07a-437e-4417-bc86-c23ad58946ae req-20b31241-0539-44e3-b20a-f37e5720488d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0517528 Nov 18 18:24:57.979695 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1ebfb07a-437e-4417-bc86-c23ad58946ae req-e4ef7105-a952-41bd-ad1f-25aeed40b7ef tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465903 Nov 18 18:24:58.107528 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de7a2550-4a3f-47da-aee2-78951b120cee req-be40ce15-b938-448d-b9e6-429bd28236bd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:58.109056 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-de7a2550-4a3f-47da-aee2-78951b120cee req-be40ce15-b938-448d-b9e6-429bd28236bd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0624905 Nov 18 18:24:58.156321 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-de7a2550-4a3f-47da-aee2-78951b120cee req-d9eaaeba-91c4-4ad8-9ea7-4f96daae1833 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413754 Nov 18 18:24:58.352317 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41374) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:58.460679 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-abb2e0e8-3595-49ff-8641-04065b5d1d7a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:58.534357 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-abb2e0e8-3595-49ff-8641-04065b5d1d7a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:58.538684 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-abb2e0e8-3595-49ff-8641-04065b5d1d7a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:58.579779 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abb2e0e8-3595-49ff-8641-04065b5d1d7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1aec81c8-712a-470c-9328-79f9cf07dd46,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:58.584086 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-abb2e0e8-3595-49ff-8641-04065b5d1d7a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f9cb7f82836f45c787860c030f5ff63d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2306900 Nov 18 18:24:58.586687 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41378) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:58.634724 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7f58d843-b454-4dc2-9ac7-35ab5b5c9a62 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:58.655802 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7f58d843-b454-4dc2-9ac7-35ab5b5c9a62 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:58.703457 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7f58d843-b454-4dc2-9ac7-35ab5b5c9a62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:58.706204 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7f58d843-b454-4dc2-9ac7-35ab5b5c9a62 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:58.707389 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-7f58d843-b454-4dc2-9ac7-35ab5b5c9a62 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1aec81c8-712a-470c-9328-79f9cf07dd46 HTTP/1.1" status: 204 len: 168 time: 0.1197712 Nov 18 18:24:58.715013 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f58d843-b454-4dc2-9ac7-35ab5b5c9a62 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1aec81c8-712a-470c-9328-79f9cf07dd46,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:58.808461 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fca70f46-910e-44aa-8972-f93e5463a0a6 req-cd5776d5-1660-4ae6-ad4f-b26275460385 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0281978 Nov 18 18:24:58.996887 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41388) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:59.010112 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7cd37fc8-4e09-4a46-a906-e72fd3e2283a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:59.117735 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7cd37fc8-4e09-4a46-a906-e72fd3e2283a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:59.125880 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7cd37fc8-4e09-4a46-a906-e72fd3e2283a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:59.144470 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b0b9bf8-a1ac-46a7-bf56-1c9c7336ed23 req-3d2e3f1c-b489-4afe-bee1-5c36b0355f7d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:59.146084 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2b0b9bf8-a1ac-46a7-bf56-1c9c7336ed23 req-3d2e3f1c-b489-4afe-bee1-5c36b0355f7d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0805333 Nov 18 18:24:59.190734 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-7cd37fc8-4e09-4a46-a906-e72fd3e2283a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=219c7d2190d54cac933ff7b3d2f32557&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1927464 Nov 18 18:24:59.193242 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41396) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:24:59.203173 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cd37fc8-4e09-4a46-a906-e72fd3e2283a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d255365c-de8b-4e53-8f5c-e4059d1a6c75,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:59.253989 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2b0b9bf8-a1ac-46a7-bf56-1c9c7336ed23 req-b84ae87d-3434-40ae-93a6-71bbcfafb99b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0967143 Nov 18 18:24:59.305732 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc0fc7ed-ffe8-42a8-8a65-a1826287f467 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:59.330620 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eebbf2d-0360-482f-a8f5-22e1a0920e51 req-1988895d-c1fe-448d-b503-11aa361a4b74 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:24:59.332221 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5eebbf2d-0360-482f-a8f5-22e1a0920e51 req-1988895d-c1fe-448d-b503-11aa361a4b74 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0773487 Nov 18 18:24:59.385499 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc0fc7ed-ffe8-42a8-8a65-a1826287f467 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:59.445863 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5eebbf2d-0360-482f-a8f5-22e1a0920e51 req-67f3c5cc-a6c4-4f00-8a4e-f34459aa5dbd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1070359 Nov 18 18:24:59.470915 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc0fc7ed-ffe8-42a8-8a65-a1826287f467 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:59.473516 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-bc0fc7ed-ffe8-42a8-8a65-a1826287f467 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:24:59.474665 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-bc0fc7ed-ffe8-42a8-8a65-a1826287f467 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d255365c-de8b-4e53-8f5c-e4059d1a6c75 HTTP/1.1" status: 204 len: 168 time: 0.2799468 Nov 18 18:24:59.482647 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc0fc7ed-ffe8-42a8-8a65-a1826287f467 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d255365c-de8b-4e53-8f5c-e4059d1a6c75,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:24:59.906486 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f1b9bb1e-9d68-4be5-b494-45cdea3a2680 req-2f1b4a25-8e8c-413a-947e-f5bca87bf7ad tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0287328 Nov 18 18:25:00.377431 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d2a968-30eb-4691-bb69-f629f7c78dcc req-127290a5-fd62-4457-a65e-25f75a5b0681 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:00.379051 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-86d2a968-30eb-4691-bb69-f629f7c78dcc req-127290a5-fd62-4457-a65e-25f75a5b0681 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0483277 Nov 18 18:25:00.442376 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-86d2a968-30eb-4691-bb69-f629f7c78dcc req-e6c8c489-a956-4da2-adf7-fd3f823746cb tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0561113 Nov 18 18:25:00.549438 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41436) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:00.559481 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fee949e-06fc-47bb-be10-dc4798db3805 req-04837b89-0c28-4afc-9efb-b15dbd9c1580 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:00.560995 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7fee949e-06fc-47bb-be10-dc4798db3805 req-04837b89-0c28-4afc-9efb-b15dbd9c1580 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0489018 Nov 18 18:25:00.608520 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7fee949e-06fc-47bb-be10-dc4798db3805 req-a78701c7-c6a2-4ef4-b050-b506a59411a9 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416698 Nov 18 18:25:00.653595 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-30312cb6-09f2-4126-a352-e7665937d36d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:00.728127 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-30312cb6-09f2-4126-a352-e7665937d36d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:00.731706 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-30312cb6-09f2-4126-a352-e7665937d36d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:00.769952 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-30312cb6-09f2-4126-a352-e7665937d36d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1b870c47237f4312a9dea54553a1f882&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2192550 Nov 18 18:25:00.770803 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30312cb6-09f2-4126-a352-e7665937d36d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f26c94a-4849-4b4d-a6cf-93c50a36e323,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:00.772697 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41440) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:00.819862 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b65dd767-2a76-440d-9243-4af32fe3cf4f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:00.840123 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b65dd767-2a76-440d-9243-4af32fe3cf4f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:00.885564 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b65dd767-2a76-440d-9243-4af32fe3cf4f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:00.888136 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b65dd767-2a76-440d-9243-4af32fe3cf4f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:00.890245 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-b65dd767-2a76-440d-9243-4af32fe3cf4f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4f26c94a-4849-4b4d-a6cf-93c50a36e323 HTTP/1.1" status: 204 len: 168 time: 0.1154244 Nov 18 18:25:00.897406 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b65dd767-2a76-440d-9243-4af32fe3cf4f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f26c94a-4849-4b4d-a6cf-93c50a36e323,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:01.008638 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b08e2884-db38-4ad9-8cf2-d9ac4fb82cfc req-ce4c00bb-caac-44f3-9da0-af172591958c tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0303729 Nov 18 18:25:01.568140 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd77b552-475d-49f9-be57-fe92c895135f req-13c20a3a-3da5-4b5b-8bd1-f51ef4c4be57 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:01.569943 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-cd77b552-475d-49f9-be57-fe92c895135f req-13c20a3a-3da5-4b5b-8bd1-f51ef4c4be57 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0542903 Nov 18 18:25:01.624464 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-cd77b552-475d-49f9-be57-fe92c895135f req-f8d74f5f-39bd-4d85-8e0f-91d5daef222c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484421 Nov 18 18:25:01.765587 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-4a614b88-480f-4d94-aa2c-c0df83fbe5b7 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:01.767295 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-4a614b88-480f-4d94-aa2c-c0df83fbe5b7 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.31 "GET /v2.0/networks?id=33a318b5-ad11-45c7-9380-7c9c44d250de HTTP/1.1" status: 200 len: 814 time: 0.1418698 Nov 18 18:25:01.782969 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e274fe-8bd1-4f17-9dde-6c698902cb7f req-458e7224-3963-4bb3-9b54-d2399e0e7a5d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:01.784474 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-23e274fe-8bd1-4f17-9dde-6c698902cb7f req-458e7224-3963-4bb3-9b54-d2399e0e7a5d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0817285 Nov 18 18:25:01.789521 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Request body: {'port': {'device_id': 'f211d1a4-033e-4318-bffa-31f11b44bace', 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de', 'admin_state_up': True, 'tenant_id': 'c9e6e099470048148cdcfa828b9a32ea'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:01.894222 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-23e274fe-8bd1-4f17-9dde-6c698902cb7f req-c1bc3267-3c19-49a3-8730-69544c69b847 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1011615 Nov 18 18:25:01.932741 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Made reservation on behalf of c9e6e099470048148cdcfa828b9a32ea for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:25:01.936383 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:02.064087 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Allocated IP 172.20.0.11 (33a318b5-ad11-45c7-9380-7c9c44d250de/15a76039-95a8-4c78-b321-326b06094f8d/f68b74ad-70ac-4b59-8ffa-4859b8aac5a8) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:25:02.115582 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-989a3b13-66fe-464e-953c-3bc9a2bfef17 req-e25f2331-41f7-4bb4-a794-376cae90552e tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0363698 Nov 18 18:25:02.239342 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:02.274332 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:02.319917 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Network 33a318b5-ad11-45c7-9380-7c9c44d250de is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:25:02.322896 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:25:02.325620 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:25:02.352850 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Pushing event updated for resources: {'Port': ['ID=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:02.380462 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:02.381520 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:02.398201 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-a7bdc503-7c70-4c7b-add2-a40762017207 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6127222 Nov 18 18:25:02.416251 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Request body: {'port': {'device_id': 'f211d1a4-033e-4318-bffa-31f11b44bace', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:02.470410 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:02.765742 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:25:02.775833 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:02.784719 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceff0b89-4232-4ec0-a66d-f24a5f10a9c0 req-90f87685-31ef-4fc2-ae92-776bcd84a264 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:02.786189 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ceff0b89-4232-4ec0-a66d-f24a5f10a9c0 req-90f87685-31ef-4fc2-ae92-776bcd84a264 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0907388 Nov 18 18:25:02.802688 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Transition to ACTIVE for port object f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:25:02.810148 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:03.100667 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Pushing event updated for resources: {'Port': ['ID=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:03.107791 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ceff0b89-4232-4ec0-a66d-f24a5f10a9c0 req-a98faaa5-4536-4beb-ad93-2c121d8f9e97 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3145761 Nov 18 18:25:03.166899 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c992cc8-86e5-49d8-92da-bc462103d96d req-a33e7b53-10b2-4ad4-8c6a-b618af9acbfa tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:03.168401 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7c992cc8-86e5-49d8-92da-bc462103d96d req-a33e7b53-10b2-4ad4-8c6a-b618af9acbfa tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.1158087 Nov 18 18:25:03.233756 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Attempting to bind port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:25:03.233999 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Attempting to bind port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '6f13a496-1ac6-44ee-a618-9dee39276ca6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:25:03.234325 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Attempting to bind port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 on network 33a318b5-ad11-45c7-9380-7c9c44d250de {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:25:03.247633 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 on network 33a318b5-ad11-45c7-9380-7c9c44d250de not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:25:03.247973 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Attempting to bind port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 on network 33a318b5-ad11-45c7-9380-7c9c44d250de {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:25:03.265054 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 24, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:25:03.265389 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Checking segment: {'id': '6f13a496-1ac6-44ee-a618-9dee39276ca6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:25:03.265773 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Bound using segment: {'id': '6f13a496-1ac6-44ee-a618-9dee39276ca6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:25:03.266200 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Bound port: f68b74ad-70ac-4b59-8ffa-4859b8aac5a8, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f13a496-1ac6-44ee-a618-9dee39276ca6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:25:03.266550 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:03.275526 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7c992cc8-86e5-49d8-92da-bc462103d96d req-ca64be7f-658e-4aea-977f-0f43b9bf8017 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0995462 Nov 18 18:25:03.288505 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-419f8717-13c4-49e5-a378-2eaea45df57a req-963bb4ac-80b3-4e1c-a5ce-06aaa291e00f tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:03.289936 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-419f8717-13c4-49e5-a378-2eaea45df57a req-963bb4ac-80b3-4e1c-a5ce-06aaa291e00f tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 944 time: 0.1062443 Nov 18 18:25:03.373904 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-419f8717-13c4-49e5-a378-2eaea45df57a req-63dfe615-0ba6-4f4a-a390-70af811d10d1 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0775893 Nov 18 18:25:03.374884 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] For port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:25:03.377939 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] For port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8,segment=NetworkSegment(6f13a496-1ac6-44ee-a618-9dee39276ca6),segment_id=6f13a496-1ac6-44ee-a618-9dee39276ca6)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:25:03.383385 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:03.415431 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:03.416074 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:03.417485 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] 10.222.0.31 "PUT /v2.0/ports/f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 HTTP/1.1" status: 200 len: 1094 time: 1.0055261 Nov 18 18:25:03.417927 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f211d1a4-033e-4318-bffa-31f11b44bace', 'tag': 'f68b74ad-70ac-4b59-8ffa-4859b8aac5a8'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:25:03.420176 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-baf49007-c224-4f91-aa0a-1b8a03a3c50d" -d '{"events": [{"name": "network-changed", "server_uuid": "f211d1a4-033e-4318-bffa-31f11b44bace", "tag": "f68b74ad-70ac-4b59-8ffa-4859b8aac5a8"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:25:03.445179 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6006a6e3-60f3-4be8-96e1-cc4cb43cdd6d service neutron] Pushing event updated for resources: {'Port': ['ID=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:03.464527 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:25:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d9b9cc29-56d0-4cb3-88c9-0fe9f710fc54 x-openstack-request-id: req-d9b9cc29-56d0-4cb3-88c9-0fe9f710fc54 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:25:03.464886 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f211d1a4-033e-4318-bffa-31f11b44bace", "tag": "f68b74ad-70ac-4b59-8ffa-4859b8aac5a8", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:25:03.465147 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-d9b9cc29-56d0-4cb3-88c9-0fe9f710fc54 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:25:03.465803 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f211d1a4-033e-4318-bffa-31f11b44bace', 'tag': 'f68b74ad-70ac-4b59-8ffa-4859b8aac5a8', 'status': 'completed', 'code': 200} Nov 18 18:25:03.513145 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-42df0aad-3489-4331-8443-4aba09143737 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:03.514519 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-42df0aad-3489-4331-8443-4aba09143737 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c9e6e099470048148cdcfa828b9a32ea&device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 1097 time: 0.0424509 Nov 18 18:25:03.557617 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-93b2fd75-5762-40fa-b4ee-1445969608a6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 HTTP/1.1" status: 200 len: 217 time: 0.0320125 Nov 18 18:25:03.611834 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-3898b225-98ad-43e5-873d-4596acd4a3af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:03.613432 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-3898b225-98ad-43e5-873d-4596acd4a3af service neutron] 10.222.0.31 "GET /v2.0/subnets?id=15a76039-95a8-4c78-b321-326b06094f8d HTTP/1.1" status: 200 len: 854 time: 0.0462797 Nov 18 18:25:03.653918 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-c0793800-305f-4342-a84e-ef84ebfd1b02 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=33a318b5-ad11-45c7-9380-7c9c44d250de&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0279481 Nov 18 18:25:03.752157 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-77b79d32-4c3d-435b-8af7-ee00dcc9c441 service neutron] 10.222.0.31 "GET /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890200 Nov 18 18:25:03.854908 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d582e8a4-0dce-442d-b30e-1285be57d76d req-3544f2b2-add4-43d9-9954-1e40ef293f6e service neutron] 10.222.0.31 "GET /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836287 Nov 18 18:25:03.972728 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baf49007-c224-4f91-aa0a-1b8a03a3c50d req-dbe5492f-8062-41d7-819c-c341263e5dff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:03.974513 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-baf49007-c224-4f91-aa0a-1b8a03a3c50d req-dbe5492f-8062-41d7-819c-c341263e5dff service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c9e6e099470048148cdcfa828b9a32ea&device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 1097 time: 0.0406625 Nov 18 18:25:03.981384 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a28a4ce2-563d-4dbc-984a-228e9c6c8692 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:04.070654 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baf49007-c224-4f91-aa0a-1b8a03a3c50d req-93bca7b3-e299-44bd-b1cb-39599772b974 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:04.072132 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-baf49007-c224-4f91-aa0a-1b8a03a3c50d req-93bca7b3-e299-44bd-b1cb-39599772b974 service neutron] 10.222.0.31 "GET /v2.0/networks?id=33a318b5-ad11-45c7-9380-7c9c44d250de HTTP/1.1" status: 200 len: 916 time: 0.0867164 Nov 18 18:25:04.125623 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-baf49007-c224-4f91-aa0a-1b8a03a3c50d req-6df99fb4-06c6-4251-bad0-e6b2ec0ac9e6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 HTTP/1.1" status: 200 len: 217 time: 0.0390246 Nov 18 18:25:04.195510 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baf49007-c224-4f91-aa0a-1b8a03a3c50d req-228164fb-5c49-4e04-99df-78fa14328e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:04.197064 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-baf49007-c224-4f91-aa0a-1b8a03a3c50d req-228164fb-5c49-4e04-99df-78fa14328e56 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=15a76039-95a8-4c78-b321-326b06094f8d HTTP/1.1" status: 200 len: 854 time: 0.0574930 Nov 18 18:25:04.240604 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-baf49007-c224-4f91-aa0a-1b8a03a3c50d req-bdf24fcd-ba19-4437-a32b-662633cbeff4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=33a318b5-ad11-45c7-9380-7c9c44d250de&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0291882 Nov 18 18:25:04.258730 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70bca0b6-7b69-4789-a0e3-db2b469e9db6 req-32dcf5cc-b447-4e3a-97bc-074631252c92 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:04.260217 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-70bca0b6-7b69-4789-a0e3-db2b469e9db6 req-32dcf5cc-b447-4e3a-97bc-074631252c92 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0784941 Nov 18 18:25:04.384906 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-70bca0b6-7b69-4789-a0e3-db2b469e9db6 req-e9f41961-2d06-4cce-9da5-0a91adc3600d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1169701 Nov 18 18:25:04.418334 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2de8611-f44c-4f01-945b-e086e33e6383 req-4c79a41b-3986-4ad3-bedc-3f00ce61ad75 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:04.419811 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c2de8611-f44c-4f01-945b-e086e33e6383 req-4c79a41b-3986-4ad3-bedc-3f00ce61ad75 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0747292 Nov 18 18:25:04.422173 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-baf49007-c224-4f91-aa0a-1b8a03a3c50d req-1938476c-0636-4ddf-abeb-6aa7e96243a7 service neutron] 10.222.0.31 "GET /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1609876 Nov 18 18:25:04.479734 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:25:04.526512 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e38da35d-d516-4c3e-865e-3d786e5f877c req-3a11c780-1165-4477-a61a-e2144a3cc10a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:04.527985 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e38da35d-d516-4c3e-865e-3d786e5f877c req-3a11c780-1165-4477-a61a-e2144a3cc10a tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.31 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 946 time: 0.0502830 Nov 18 18:25:04.547081 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c2de8611-f44c-4f01-945b-e086e33e6383 req-7b363e4b-7ee5-46f4-83ef-f37e961d9dbb tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1205549 Nov 18 18:25:04.570631 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aa84110-a68a-4bdd-9824-9d737a4a8866 req-5c4ba3cf-976e-4b37-be77-bf247aaf3f58 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:04.572189 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0aa84110-a68a-4bdd-9824-9d737a4a8866 req-5c4ba3cf-976e-4b37-be77-bf247aaf3f58 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 944 time: 0.1246352 Nov 18 18:25:04.603147 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-baf49007-c224-4f91-aa0a-1b8a03a3c50d req-e48b70ce-069e-4e3f-9eb1-ee5afa5d60ec service neutron] 10.222.0.31 "GET /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1692765 Nov 18 18:25:04.629706 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0aa84110-a68a-4bdd-9824-9d737a4a8866 req-538e8ea9-3b2f-444a-aab5-4104f6f2978d tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499103 Nov 18 18:25:04.643062 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [req-e38da35d-d516-4c3e-865e-3d786e5f877c req-d225ff8d-38ee-4a42-a672-3f0bc9628a25 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Deleting port 13fa8d72-ea18-463c-9382-23f28f110133 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:25:04.643492 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e38da35d-d516-4c3e-865e-3d786e5f877c req-d225ff8d-38ee-4a42-a672-3f0bc9628a25 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:04.732678 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-e38da35d-d516-4c3e-865e-3d786e5f877c req-d225ff8d-38ee-4a42-a672-3f0bc9628a25 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] For port 13fa8d72-ea18-463c-9382-23f28f110133, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=13fa8d72-ea18-463c-9382-23f28f110133,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:25:04.733034 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e38da35d-d516-4c3e-865e-3d786e5f877c req-d225ff8d-38ee-4a42-a672-3f0bc9628a25 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:04.746004 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [req-e38da35d-d516-4c3e-865e-3d786e5f877c req-d225ff8d-38ee-4a42-a672-3f0bc9628a25 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Calling delete_port for 13fa8d72-ea18-463c-9382-23f28f110133 owned by compute:nova {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:25:04.872127 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e38da35d-d516-4c3e-865e-3d786e5f877c req-d225ff8d-38ee-4a42-a672-3f0bc9628a25 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:04.893582 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['b627bee7-04b0-4a31-8ff0-84f976c65917', '13fa8d72-ea18-463c-9382-23f28f110133'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:25:04.899574 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d225ff8d-38ee-4a42-a672-3f0bc9628a25 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Pushing event deleted for resources: {'Port': ['ID=13fa8d72-ea18-463c-9382-23f28f110133,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:04.941582 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-e38da35d-d516-4c3e-865e-3d786e5f877c req-d225ff8d-38ee-4a42-a672-3f0bc9628a25 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] No DVR routers for this DVR port 13fa8d72-ea18-463c-9382-23f28f110133 on host hv-cinder-78776 {{(pid=102688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:25:04.944734 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e38da35d-d516-4c3e-865e-3d786e5f877c req-d225ff8d-38ee-4a42-a672-3f0bc9628a25 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:04.948254 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e38da35d-d516-4c3e-865e-3d786e5f877c req-d225ff8d-38ee-4a42-a672-3f0bc9628a25 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.31 "DELETE /v2.0/ports/13fa8d72-ea18-463c-9382-23f28f110133 HTTP/1.1" status: 204 len: 173 time: 0.3977640 Nov 18 18:25:04.948648 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f1461fa4-a91b-4537-9c81-67ab32f8d50e', 'name': 'network-vif-deleted', 'tag': '13fa8d72-ea18-463c-9382-23f28f110133'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:25:04.950984 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7582eeb5-c69f-4678-a249-afd11293702b" -d '{"events": [{"server_uuid": "f1461fa4-a91b-4537-9c81-67ab32f8d50e", "name": "network-vif-deleted", "tag": "13fa8d72-ea18-463c-9382-23f28f110133"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:25:04.997965 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:25:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c0ed43b5-f3db-453a-98e1-f87a938e1f22 x-openstack-request-id: req-c0ed43b5-f3db-453a-98e1-f87a938e1f22 {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:25:04.998259 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f1461fa4-a91b-4537-9c81-67ab32f8d50e", "name": "network-vif-deleted", "tag": "13fa8d72-ea18-463c-9382-23f28f110133", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:25:04.998516 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-c0ed43b5-f3db-453a-98e1-f87a938e1f22 {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:25:04.998899 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f1461fa4-a91b-4537-9c81-67ab32f8d50e', 'name': 'network-vif-deleted', 'tag': '13fa8d72-ea18-463c-9382-23f28f110133', 'status': 'completed', 'code': 200} Nov 18 18:25:05.038400 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41536) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:05.151888 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-56395d1a-baaf-45ea-8356-50056f246533 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:05.224281 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-56395d1a-baaf-45ea-8356-50056f246533 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:05.228475 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-56395d1a-baaf-45ea-8356-50056f246533 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:05.264880 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-56395d1a-baaf-45ea-8356-50056f246533 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=26da1402c8db46999d174e5e450c28d2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2245989 Nov 18 18:25:05.265729 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56395d1a-baaf-45ea-8356-50056f246533 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7cbef40a-6368-48ab-88e5-48ce891bdebd,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:05.267849 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41540) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:05.315657 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9ab5d280-c859-415c-a1e8-571f223b2643 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:05.336432 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9ab5d280-c859-415c-a1e8-571f223b2643 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:05.384580 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9ab5d280-c859-415c-a1e8-571f223b2643 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:05.387130 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9ab5d280-c859-415c-a1e8-571f223b2643 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:05.388285 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-9ab5d280-c859-415c-a1e8-571f223b2643 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7cbef40a-6368-48ab-88e5-48ce891bdebd HTTP/1.1" status: 204 len: 168 time: 0.1193852 Nov 18 18:25:05.395740 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ab5d280-c859-415c-a1e8-571f223b2643 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cbef40a-6368-48ab-88e5-48ce891bdebd,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:05.514186 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ca04b22-67fc-4ebd-9de5-347e2a2f7c11 req-493247e3-9dc7-40b1-8169-c2c7720ec863 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:05.515804 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6ca04b22-67fc-4ebd-9de5-347e2a2f7c11 req-493247e3-9dc7-40b1-8169-c2c7720ec863 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0524099 Nov 18 18:25:05.563365 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6ca04b22-67fc-4ebd-9de5-347e2a2f7c11 req-c7557cd2-8692-4fe9-960e-560b47c95045 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417359 Nov 18 18:25:05.654118 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41552) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:05.688419 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8c2d7636-d4e8-44c3-a970-6f0d62199455 req-3624eb91-d396-4ddc-a00e-a35189a137d4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=f1461fa4-a91b-4537-9c81-67ab32f8d50e HTTP/1.1" status: 200 len: 210 time: 0.0446787 Nov 18 18:25:05.775234 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb5fabb-0359-423a-95cb-0a8280b157c1 req-dbfcbee3-1e3d-4c04-b0d1-f46340558789 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:05.781478 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3eb5fabb-0359-423a-95cb-0a8280b157c1 req-dbfcbee3-1e3d-4c04-b0d1-f46340558789 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 944 time: 0.0627656 Nov 18 18:25:05.829117 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3eb5fabb-0359-423a-95cb-0a8280b157c1 req-d8767f45-b564-4c22-a16b-0088d7c91297 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458040 Nov 18 18:25:05.875873 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4ab4ab89-cc03-4347-b3ad-60f243084b35 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:05.948208 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4ab4ab89-cc03-4347-b3ad-60f243084b35 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:05.951512 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4ab4ab89-cc03-4347-b3ad-60f243084b35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:05.987456 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-4ab4ab89-cc03-4347-b3ad-60f243084b35 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=efe99a5a372d4aa89bbbebea152ac768&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3317399 Nov 18 18:25:05.988338 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ab4ab89-cc03-4347-b3ad-60f243084b35 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f073143-79a6-4127-8694-2ca9a4ec9565,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:05.990723 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41558) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:06.037259 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4e34c4f0-b050-4e35-b029-d8d5bc5154c6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:06.060950 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4e34c4f0-b050-4e35-b029-d8d5bc5154c6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:06.105837 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4e34c4f0-b050-4e35-b029-d8d5bc5154c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:06.108490 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4e34c4f0-b050-4e35-b029-d8d5bc5154c6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:06.109614 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-4e34c4f0-b050-4e35-b029-d8d5bc5154c6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6f073143-79a6-4127-8694-2ca9a4ec9565 HTTP/1.1" status: 204 len: 168 time: 0.1177640 Nov 18 18:25:06.117244 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e34c4f0-b050-4e35-b029-d8d5bc5154c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f073143-79a6-4127-8694-2ca9a4ec9565,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:06.429256 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-83b6e3de-9357-4a64-b915-f1448ba0b440 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:06.687613 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f3d4138-a77d-4c2f-98b1-73ce5382d311 req-97d43130-cb11-4458-86d2-26248761718c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:06.689154 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1f3d4138-a77d-4c2f-98b1-73ce5382d311 req-97d43130-cb11-4458-86d2-26248761718c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0500400 Nov 18 18:25:06.737761 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1f3d4138-a77d-4c2f-98b1-73ce5382d311 req-d9a51ee0-e95c-4781-ac43-65b2c14ee125 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415723 Nov 18 18:25:06.979297 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e311f164-b607-41e2-88b9-9bb712a6c4cb req-dfa7b75d-5603-490f-8fcd-e7c789277148 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:06.980726 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e311f164-b607-41e2-88b9-9bb712a6c4cb req-dfa7b75d-5603-490f-8fcd-e7c789277148 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 944 time: 0.0762849 Nov 18 18:25:07.002027 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cfdf336-5a59-490b-a835-8175452a3b7e req-abf3a2ba-ef27-4f84-8528-d439ac0cbde9 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:07.003434 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7cfdf336-5a59-490b-a835-8175452a3b7e req-abf3a2ba-ef27-4f84-8528-d439ac0cbde9 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0734680 Nov 18 18:25:07.064287 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e311f164-b607-41e2-88b9-9bb712a6c4cb req-351b4efa-ed01-447a-9447-8e04da723959 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0755863 Nov 18 18:25:07.076413 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7cfdf336-5a59-490b-a835-8175452a3b7e req-57325398-4793-4a29-af1e-b985b88e267d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651166 Nov 18 18:25:07.646249 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:25:07.731481 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:07.751692 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8,segment=NetworkSegment(6f13a496-1ac6-44ee-a618-9dee39276ca6),segment_id=6f13a496-1ac6-44ee-a618-9dee39276ca6)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:25:07.762746 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': 'f68b74ad-70ac-4b59-8ffa-4859b8aac5a8', 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de', 'port_id': 'f68b74ad-70ac-4b59-8ffa-4859b8aac5a8', 'mac_address': 'fa:16:3e:25:a0:fe', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1322, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '15a76039-95a8-4c78-b321-326b06094f8d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:25:07.800056 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:07.812931 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:25:07.835013 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8,segment=NetworkSegment(6f13a496-1ac6-44ee-a618-9dee39276ca6),segment_id=6f13a496-1ac6-44ee-a618-9dee39276ca6)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:25:07.839545 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:07.866125 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb3892a1-ca82-4a26-854f-19f397c571ff req-f9d66c14-8126-43d0-a95f-a8dacd851f82 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:07.867646 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bb3892a1-ca82-4a26-854f-19f397c571ff req-f9d66c14-8126-43d0-a95f-a8dacd851f82 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.0499880 Nov 18 18:25:07.899559 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:07.920692 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bb3892a1-ca82-4a26-854f-19f397c571ff req-f6282cda-4698-4b93-9613-7add16574c97 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438225 Nov 18 18:25:08.048251 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4d03c9-6025-467b-8266-56b510106a6b req-034f7fb6-79ff-4e96-9844-6ae36fb50dd7 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:08.049712 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7c4d03c9-6025-467b-8266-56b510106a6b req-034f7fb6-79ff-4e96-9844-6ae36fb50dd7 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 946 time: 0.0510929 Nov 18 18:25:08.096051 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7c4d03c9-6025-467b-8266-56b510106a6b req-77f2ba4c-b705-47a7-a172-6d5e2d1007fb tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404837 Nov 18 18:25:08.119238 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41614) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:08.205087 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68650fcc-3192-45d1-a7c5-bb71025a7915 req-c1a7dac0-b104-4304-b7d5-e0a26bf31f90 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:08.206584 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-68650fcc-3192-45d1-a7c5-bb71025a7915 req-c1a7dac0-b104-4304-b7d5-e0a26bf31f90 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 945 time: 0.0777123 Nov 18 18:25:08.232275 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['f68b74ad-70ac-4b59-8ffa-4859b8aac5a8'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:25:08.234008 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66f5b58e-f8fa-45a0-95c2-fa8251013e2a req-98a88ffd-19f2-4e23-afe7-6ad2415aee63 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:08.235510 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-66f5b58e-f8fa-45a0-95c2-fa8251013e2a req-98a88ffd-19f2-4e23-afe7-6ad2415aee63 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0773971 Nov 18 18:25:08.317258 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-66f5b58e-f8fa-45a0-95c2-fa8251013e2a req-77021c2b-4232-484f-9c9e-9554b8745daf tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747194 Nov 18 18:25:08.333880 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-68650fcc-3192-45d1-a7c5-bb71025a7915 req-ef1f1efb-d0df-47d2-90ea-5c37062b9a9e tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1201942 Nov 18 18:25:08.363660 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ad7f0a7-8cb1-4327-94b1-5c49fc878b46 tempest-TestMinimumBasicScenario-546434197 tempest-TestMinimumBasicScenario-546434197-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:08.368496 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-3ad7f0a7-8cb1-4327-94b1-5c49fc878b46 tempest-TestMinimumBasicScenario-546434197 tempest-TestMinimumBasicScenario-546434197-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 1094 time: 0.2449253 Nov 18 18:25:08.368628 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41624) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:08.373038 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Request body: {'floatingip': {'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'port_id': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'fixed_ip_address': '172.20.0.14'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:08.395720 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for floatingip, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:08.492308 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:08.599181 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Allocated IP 172.27.1.117 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/78969e89-e9b9-4bca-8f8e-f9a6aa750ff2) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:25:08.705538 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:08.741481 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:08.781703 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:25:08.786249 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:25:08.789332 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:25:08.823423 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event updated for resources: {'Port': ['ID=78969e89-e9b9-4bca-8f8e-f9a6aa750ff2,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:09.048589 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:09.106182 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70442c06-9ed2-499b-a372-056bf9ba076f req-2385eeb0-45f9-4bda-b091-8d9f69c0ed7a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:09.107650 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-70442c06-9ed2-499b-a372-056bf9ba076f req-2385eeb0-45f9-4bda-b091-8d9f69c0ed7a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 943 time: 0.1052001 Nov 18 18:25:09.222443 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-70442c06-9ed2-499b-a372-056bf9ba076f req-a438cf70-4995-4d56-adf1-afe5c2568354 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1064818 Nov 18 18:25:09.238719 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:09.303950 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:09.662169 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b8ded38f-97b4-485b-9845-705c1fb9701d details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:25:09.667209 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:25:09.707324 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520ef942-68db-4ddb-9e8e-95fd0ac3edca req-178e924d-6ef0-4fda-b0b8-a26d77970ec0 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:09.708838 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-520ef942-68db-4ddb-9e8e-95fd0ac3edca req-178e924d-6ef0-4fda-b0b8-a26d77970ec0 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.3061202 Nov 18 18:25:09.723966 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9a1a446-5b34-48dd-83cd-bcb7879187e5 req-12cf0201-e624-4699-926a-27ed5ef6876c tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:09.726015 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a9a1a446-5b34-48dd-83cd-bcb7879187e5 req-12cf0201-e624-4699-926a-27ed5ef6876c tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 945 time: 0.3201091 Nov 18 18:25:09.748753 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:09.761095 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:09.777034 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:25:09.784241 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:25:09.784612 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:09.817266 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b8ded38f-97b4-485b-9845-705c1fb9701d,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:25:09.833431 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'port_id': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'mac_address': 'fa:16:3e:9b:a4:2d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1342, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:25:09.877250 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event updated for resources: {'Port': ['ID=78969e89-e9b9-4bca-8f8e-f9a6aa750ff2,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:09.885046 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-520ef942-68db-4ddb-9e8e-95fd0ac3edca req-f88b28b7-5ee5-4e92-83df-fb58e61a56a3 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1581061 Nov 18 18:25:09.892331 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a9a1a446-5b34-48dd-83cd-bcb7879187e5 req-663fe3bd-955e-4c24-9f0d-ae299c34cacb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1484168 Nov 18 18:25:09.897030 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:09.897853 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:09.920552 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b8ded38f-97b4-485b-9845-705c1fb9701d {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:25:09.943781 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:09.958775 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b8ded38f-97b4-485b-9845-705c1fb9701d,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:25:09.969274 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:09.996075 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f211d1a4-033e-4318-bffa-31f11b44bace', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f68b74ad-70ac-4b59-8ffa-4859b8aac5a8'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:25:09.998313 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1f0d684-ff69-45dc-ba84-80c393d2e90d" -d '{"events": [{"server_uuid": "f211d1a4-033e-4318-bffa-31f11b44bace", "name": "network-vif-plugged", "status": "completed", "tag": "f68b74ad-70ac-4b59-8ffa-4859b8aac5a8"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:25:10.012304 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Floating IP 82bfb0bb-ed3d-4d27-bc0c-e435f8e3dda2 associated. External IP: 172.27.1.117, port: e535328b-e6c3-4630-a314-5bd8ccdaad80. Nov 18 18:25:10.014398 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8,segment=NetworkSegment(6f13a496-1ac6-44ee-a618-9dee39276ca6),segment_id=6f13a496-1ac6-44ee-a618-9dee39276ca6)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:25:10.044523 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.045329 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 13fa8d72-ea18-463c-9382-23f28f110133 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:25:10.049766 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:25:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd2bcc29-dbb1-4034-b5e5-b2aefd70aea8 x-openstack-request-id: req-cd2bcc29-dbb1-4034-b5e5-b2aefd70aea8 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:25:10.050403 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f211d1a4-033e-4318-bffa-31f11b44bace", "name": "network-vif-plugged", "status": "completed", "tag": "f68b74ad-70ac-4b59-8ffa-4859b8aac5a8", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:25:10.050514 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-cd2bcc29-dbb1-4034-b5e5-b2aefd70aea8 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:25:10.051198 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f211d1a4-033e-4318-bffa-31f11b44bace', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f68b74ad-70ac-4b59-8ffa-4859b8aac5a8', 'code': 200} Nov 18 18:25:10.077014 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=b8ded38f-97b4-485b-9845-705c1fb9701d,revision_number=9']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:10.118300 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: 13fa8d72-ea18-463c-9382-23f28f110133 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:25:10.118650 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 13fa8d72-ea18-463c-9382-23f28f110133 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:25:10.143254 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:10.177452 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.245910 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41664) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:10.289395 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Router e8464c87-c9dc-43f0-9906-eda0c4a24cdb has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:25:10.306492 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56de3734-fd7f-416f-b002-b02174a10384 req-686b00ef-77ff-4a1d-b0a2-2ee11413afd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:10.308873 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-56de3734-fd7f-416f-b002-b02174a10384 req-686b00ef-77ff-4a1d-b0a2-2ee11413afd8 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 1099 time: 0.0670731 Nov 18 18:25:10.338157 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['b8ded38f-97b4-485b-9845-705c1fb9701d'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:25:10.364067 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-56de3734-fd7f-416f-b002-b02174a10384 req-4f8a186b-a447-43c6-8aa1-b12c23ff786f service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447617 Nov 18 18:25:10.394466 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-659e6e48-491c-4ff2-a979-4be5f050b995 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.459709 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab588c4d-48b0-4608-80b7-f2de2df9546a req-4ca76749-b9ff-4b71-8939-b378d4367b3f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:10.461133 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ab588c4d-48b0-4608-80b7-f2de2df9546a req-4ca76749-b9ff-4b71-8939-b378d4367b3f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 944 time: 0.1258900 Nov 18 18:25:10.480091 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:25:10.490145 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14f88cae-566e-4400-9e78-e5ca7d4ed8f9 None None] Sync routers for ids ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:25:10.499417 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14f88cae-566e-4400-9e78-e5ca7d4ed8f9 None None] Routers {'e8464c87-c9dc-43f0-9906-eda0c4a24cdb'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:25:10.500234 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-14f88cae-566e-4400-9e78-e5ca7d4ed8f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:25:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:10.527910 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.574027 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ab588c4d-48b0-4608-80b7-f2de2df9546a req-51e02df0-f342-429e-a5f8-bcb7dc5bf32e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1044717 Nov 18 18:25:10.584742 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-c0b04583-fc97-4d3f-86b7-90b182637e07 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.2120693 Nov 18 18:25:10.584742 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:25:10.586302 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41670) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:10.586444 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cc25719b-6591-4d86-9a48-9fa782bbd1d8" -d '{"events": [{"name": "network-changed", "server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:25:10.603885 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-400ee229-25b7-458d-8aac-2906124eeb2d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1849061746', 'description': 'tempest-secgroup-smoke-1849061746 description', 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:10.619853 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-659e6e48-491c-4ff2-a979-4be5f050b995 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.620308 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-400ee229-25b7-458d-8aac-2906124eeb2d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.629143 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-659e6e48-491c-4ff2-a979-4be5f050b995 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.630782 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-14f88cae-566e-4400-9e78-e5ca7d4ed8f9 None None] Set router e8464c87-c9dc-43f0-9906-eda0c4a24cdb gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:25:10.632697 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:25:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0473bc8c-f07a-4436-933b-f90009eeb70a x-openstack-request-id: req-0473bc8c-f07a-4436-933b-f90009eeb70a {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:25:10.632998 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:25:10.633260 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-0473bc8c-f07a-4436-933b-f90009eeb70a {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:25:10.633653 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'status': 'completed', 'code': 200} Nov 18 18:25:10.675631 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-659e6e48-491c-4ff2-a979-4be5f050b995 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92296f5d-f9e7-435b-a54e-a80e47b9cdfd,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:10.682436 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-659e6e48-491c-4ff2-a979-4be5f050b995 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b0aa905d282541c781192702fa312bb8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4331264 Nov 18 18:25:10.682676 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41674) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:10.739355 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d158b62d-4650-4161-8b2b-29085e876125 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.739895 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-400ee229-25b7-458d-8aac-2906124eeb2d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.745047 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-400ee229-25b7-458d-8aac-2906124eeb2d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.761158 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc25719b-6591-4d86-9a48-9fa782bbd1d8 req-5a02f878-a853-435d-891a-54731f09961b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:10.761158 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cc25719b-6591-4d86-9a48-9fa782bbd1d8 req-5a02f878-a853-435d-891a-54731f09961b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=46a1cb48de6e4f43a563f40fd92f0bf0&device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 1099 time: 0.0906715 Nov 18 18:25:10.768741 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d158b62d-4650-4161-8b2b-29085e876125 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.796800 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-400ee229-25b7-458d-8aac-2906124eeb2d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.800856 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-400ee229-25b7-458d-8aac-2906124eeb2d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2100925 Nov 18 18:25:10.801408 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41676) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:10.806577 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-ffef7956-0c31-419e-8040-5187ad16ac0c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Request body: {'security_group_rule': {'security_group_id': '43932994-97a2-4b28-a8c8-cacaf8d0e5e6', 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:10.807719 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-400ee229-25b7-458d-8aac-2906124eeb2d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event updated for resources: {'SecurityGroup': ['ID=43932994-97a2-4b28-a8c8-cacaf8d0e5e6,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:10.842453 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ffef7956-0c31-419e-8040-5187ad16ac0c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.847280 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d158b62d-4650-4161-8b2b-29085e876125 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.850055 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d158b62d-4650-4161-8b2b-29085e876125 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.854417 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-d158b62d-4650-4161-8b2b-29085e876125 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/92296f5d-f9e7-435b-a54e-a80e47b9cdfd HTTP/1.1" status: 204 len: 168 time: 0.1705956 Nov 18 18:25:10.871388 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d158b62d-4650-4161-8b2b-29085e876125 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92296f5d-f9e7-435b-a54e-a80e47b9cdfd,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:10.897998 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc25719b-6591-4d86-9a48-9fa782bbd1d8 req-a7c144fd-e2ec-415d-a70d-de302e0cb4c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:10.900068 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cc25719b-6591-4d86-9a48-9fa782bbd1d8 req-a7c144fd-e2ec-415d-a70d-de302e0cb4c6 service neutron] 10.222.0.31 "GET /v2.0/networks?id=c5332eb5-c186-4bcf-89d9-eb78be973548 HTTP/1.1" status: 200 len: 917 time: 0.1312759 Nov 18 18:25:10.936252 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ffef7956-0c31-419e-8040-5187ad16ac0c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.948877 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ffef7956-0c31-419e-8040-5187ad16ac0c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:10.982587 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffef7956-0c31-419e-8040-5187ad16ac0c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cf9e9bff-edbc-4558-99d4-f2a7bb7228f5,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:11.004671 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cc25719b-6591-4d86-9a48-9fa782bbd1d8 req-8f1aff4e-ec55-4f2c-824d-d2baed32d840 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80 HTTP/1.1" status: 200 len: 1000 time: 0.0858610 Nov 18 18:25:11.011529 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ffef7956-0c31-419e-8040-5187ad16ac0c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.012700 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-14f88cae-566e-4400-9e78-e5ca7d4ed8f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:33Z', 'revision_number': 4, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '82bfb0bb-ed3d-4d27-bc0c-e435f8e3dda2', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'floating_ip_address': '172.27.1.117', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'port_id': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 421, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'mac_address': 'fa:16:3e:43:14:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:25:09Z', 'updated_at': '2021-11-18T18:25:09Z', 'revision_number': 0, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6401bf2f-1763-4e1c-9200-1fa1bff41750', 'name': '', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'mac_address': 'fa:16:3e:e5:54:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_interface', 'standard_attr_id': 354, 'fixed_ips': [{'subnet_id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:31Z', 'updated_at': '2021-11-18T18:23:38Z', 'revision_number': 5, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'subnets': [{'id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:11.013291 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-ffef7956-0c31-419e-8040-5187ad16ac0c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2106831 Nov 18 18:25:11.016502 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41684) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:11.021153 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-f3b53ff5-e2cd-416d-a3b8-0a522a55e398 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Request body: {'security_group_rule': {'security_group_id': '43932994-97a2-4b28-a8c8-cacaf8d0e5e6', 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:11.049549 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14f88cae-566e-4400-9e78-e5ca7d4ed8f9 None None] Checking router: e8464c87-c9dc-43f0-9906-eda0c4a24cdb for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:25:11.061121 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14f88cae-566e-4400-9e78-e5ca7d4ed8f9 None None] Routers {'e8464c87-c9dc-43f0-9906-eda0c4a24cdb'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:25:11.062207 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-14f88cae-566e-4400-9e78-e5ca7d4ed8f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:25:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:11.067063 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc25719b-6591-4d86-9a48-9fa782bbd1d8 req-41a07962-069d-4f0a-b6c2-9e32ae85fbf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:11.070128 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cc25719b-6591-4d86-9a48-9fa782bbd1d8 req-41a07962-069d-4f0a-b6c2-9e32ae85fbf8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24097eeb-7eeb-4617-b83d-a363de5de9b1 HTTP/1.1" status: 200 len: 854 time: 0.0541627 Nov 18 18:25:11.123901 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbce9f40-0a98-42c3-9137-67706559f85c req-3d23fd82-f782-4a99-82ef-e7df891b8c28 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:11.125452 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bbce9f40-0a98-42c3-9137-67706559f85c req-3d23fd82-f782-4a99-82ef-e7df891b8c28 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.1100264 Nov 18 18:25:11.128579 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3b53ff5-e2cd-416d-a3b8-0a522a55e398 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.137348 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc25719b-6591-4d86-9a48-9fa782bbd1d8 req-d2f60339-dcbb-4bec-83d2-7c634956ead2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:11.138852 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cc25719b-6591-4d86-9a48-9fa782bbd1d8 req-d2f60339-dcbb-4bec-83d2-7c634956ead2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c5332eb5-c186-4bcf-89d9-eb78be973548&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0588744 Nov 18 18:25:11.157392 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a0d3146-ab84-4165-9423-0a09669388eb req-a94d4bec-00a9-4686-be25-61fb6d6dea52 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:11.158899 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a0d3146-ab84-4165-9423-0a09669388eb req-a94d4bec-00a9-4686-be25-61fb6d6dea52 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 946 time: 0.1309161 Nov 18 18:25:11.186718 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-14f88cae-566e-4400-9e78-e5ca7d4ed8f9 None None] Set router e8464c87-c9dc-43f0-9906-eda0c4a24cdb gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:25:11.252907 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cc25719b-6591-4d86-9a48-9fa782bbd1d8 req-8fe32fb9-2d5b-4b0c-b703-f227baf6a3ea service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1000519 Nov 18 18:25:11.257767 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bbce9f40-0a98-42c3-9137-67706559f85c req-e4ada6d8-1c5e-4001-b2b2-7a520d6a0483 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1228416 Nov 18 18:25:11.278681 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3b53ff5-e2cd-416d-a3b8-0a522a55e398 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.282451 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6a0d3146-ab84-4165-9423-0a09669388eb req-b9366a1b-061d-4f0a-97b9-01edec0f7695 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1090727 Nov 18 18:25:11.286621 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3b53ff5-e2cd-416d-a3b8-0a522a55e398 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.315640 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3b53ff5-e2cd-416d-a3b8-0a522a55e398 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=938d2b6d-1ee0-4f47-bb7f-c3b99f90b2ff,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:11.333086 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3b53ff5-e2cd-416d-a3b8-0a522a55e398 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.338495 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-f3b53ff5-e2cd-416d-a3b8-0a522a55e398 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3207386 Nov 18 18:25:11.339111 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41694) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:11.356204 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-914da862-bc8f-42bb-bce4-8bd48dc8344d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Request body: {'security_group_rule': {'security_group_id': '43932994-97a2-4b28-a8c8-cacaf8d0e5e6', 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:11.393867 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cc25719b-6591-4d86-9a48-9fa782bbd1d8 req-14239946-1fb6-4ba2-840c-1a22564ded9e service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1274593 Nov 18 18:25:11.398543 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-914da862-bc8f-42bb-bce4-8bd48dc8344d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.503704 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-14f88cae-566e-4400-9e78-e5ca7d4ed8f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:33Z', 'revision_number': 4, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '82bfb0bb-ed3d-4d27-bc0c-e435f8e3dda2', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'floating_ip_address': '172.27.1.117', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'port_id': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 421, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'mac_address': 'fa:16:3e:43:14:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:25:09Z', 'updated_at': '2021-11-18T18:25:09Z', 'revision_number': 0, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6401bf2f-1763-4e1c-9200-1fa1bff41750', 'name': '', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'mac_address': 'fa:16:3e:e5:54:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_interface', 'standard_attr_id': 354, 'fixed_ips': [{'subnet_id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:31Z', 'updated_at': '2021-11-18T18:23:38Z', 'revision_number': 5, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'subnets': [{'id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:11.514194 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-914da862-bc8f-42bb-bce4-8bd48dc8344d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.519681 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-914da862-bc8f-42bb-bce4-8bd48dc8344d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.537771 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14f88cae-566e-4400-9e78-e5ca7d4ed8f9 None None] The sync data for ids ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'] in dv-cinder-787764-6-iscsi is: [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:33Z', 'revision_number': 4, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '82bfb0bb-ed3d-4d27-bc0c-e435f8e3dda2', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'floating_ip_address': '172.27.1.117', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'port_id': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 421, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'mac_address': 'fa:16:3e:43:14:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:25:09Z', 'updated_at': '2021-11-18T18:25:09Z', 'revision_number': 0, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6401bf2f-1763-4e1c-9200-1fa1bff41750', 'name': '', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'mac_address': 'fa:16:3e:e5:54:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_interface', 'standard_attr_id': 354, 'fixed_ips': [{'subnet_id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:31Z', 'updated_at': '2021-11-18T18:23:38Z', 'revision_number': 5, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'subnets': [{'id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:25:11.538332 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-914da862-bc8f-42bb-bce4-8bd48dc8344d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9f10b32a-6450-42e2-a92d-6f8be4c28f09,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:11.551271 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-914da862-bc8f-42bb-bce4-8bd48dc8344d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.555689 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-914da862-bc8f-42bb-bce4-8bd48dc8344d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2124517 Nov 18 18:25:11.555888 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41698) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:11.560397 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-4840f371-aecc-4e26-99c2-89e0bc757d01 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Request body: {'security_group_rule': {'security_group_id': '43932994-97a2-4b28-a8c8-cacaf8d0e5e6', 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:11.589962 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4840f371-aecc-4e26-99c2-89e0bc757d01 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.667161 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4840f371-aecc-4e26-99c2-89e0bc757d01 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.679083 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4840f371-aecc-4e26-99c2-89e0bc757d01 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.693133 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b8ded38f-97b4-485b-9845-705c1fb9701d up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:25:11.711187 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4840f371-aecc-4e26-99c2-89e0bc757d01 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a7f6815f-3701-48c1-a72d-99576e175f09,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:11.731276 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4840f371-aecc-4e26-99c2-89e0bc757d01 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.732870 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-4840f371-aecc-4e26-99c2-89e0bc757d01 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1755800 Nov 18 18:25:11.735404 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41708) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:11.741206 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-e840c7d8-459c-4f75-83f2-79236694d6fc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Request body: {'security_group_rule': {'security_group_id': '43932994-97a2-4b28-a8c8-cacaf8d0e5e6', 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:11.784650 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port b8ded38f-97b4-485b-9845-705c1fb9701d triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:25:11.785384 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.786729 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d91def-72fb-46b4-9f68-e883b19749c6 req-7708baec-f71a-4d2c-96f3-9918ff491e30 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:11.789316 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-24d91def-72fb-46b4-9f68-e883b19749c6 req-7708baec-f71a-4d2c-96f3-9918ff491e30 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 944 time: 0.1208484 Nov 18 18:25:11.825314 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.securitygroups_db [None req-e840c7d8-459c-4f75-83f2-79236694d6fc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Project 46a1cb48de6e4f43a563f40fd92f0bf0 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 18 18:25:11.843133 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6816ea4-f1f5-4a2e-917a-06429f280afb None None] New status for floating IP 82bfb0bb-ed3d-4d27-bc0c-e435f8e3dda2: ACTIVE {{(pid=102690) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:25:11.882073 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-24d91def-72fb-46b4-9f68-e883b19749c6 req-ab68af01-f5d2-4ad1-b790-4b86eab9a4dd tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0841880 Nov 18 18:25:11.888838 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e840c7d8-459c-4f75-83f2-79236694d6fc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.987438 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e840c7d8-459c-4f75-83f2-79236694d6fc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:11.993879 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e840c7d8-459c-4f75-83f2-79236694d6fc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:12.012982 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e840c7d8-459c-4f75-83f2-79236694d6fc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d286048e-cd24-475e-af37-e5f7b32dfcc5,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:12.032994 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e840c7d8-459c-4f75-83f2-79236694d6fc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:12.034377 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-e840c7d8-459c-4f75-83f2-79236694d6fc tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2979977 Nov 18 18:25:12.037335 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41716) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:12.043793 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-df5f1bb5-7db8-46c8-a437-398be7822415 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Request body: {'security_group_rule': {'security_group_id': '43932994-97a2-4b28-a8c8-cacaf8d0e5e6', 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:12.065744 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:12.084093 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.securitygroups_db [None req-df5f1bb5-7db8-46c8-a437-398be7822415 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Project 46a1cb48de6e4f43a563f40fd92f0bf0 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 18 18:25:12.090146 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-df5f1bb5-7db8-46c8-a437-398be7822415 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:12.121948 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:25:12.131140 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-179aaaf1-cdaa-4bb2-b9ad-9280a1e0ddbd" -d '{"events": [{"server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "name": "network-vif-plugged", "status": "completed", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:25:12.146286 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b8ded38f-97b4-485b-9845-705c1fb9701d,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:25:12.154354 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:12.166349 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-df5f1bb5-7db8-46c8-a437-398be7822415 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:12.174332 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-df5f1bb5-7db8-46c8-a437-398be7822415 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:12.193371 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:25:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-38424809-3ed9-4332-ad4f-07266b1398cb x-openstack-request-id: req-38424809-3ed9-4332-ad4f-07266b1398cb {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:25:12.193905 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "name": "network-vif-plugged", "status": "completed", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:25:12.194245 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df5f1bb5-7db8-46c8-a437-398be7822415 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2551e647-d118-4c64-830e-070e6d136123,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:12.194514 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-38424809-3ed9-4332-ad4f-07266b1398cb {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:25:12.195058 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'code': 200} Nov 18 18:25:12.220953 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=b8ded38f-97b4-485b-9845-705c1fb9701d,revision_number=10']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:12.234229 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-df5f1bb5-7db8-46c8-a437-398be7822415 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:12.238344 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-df5f1bb5-7db8-46c8-a437-398be7822415 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1971722 Nov 18 18:25:12.333202 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-af952840-e13f-47c0-b8d3-8e1b700c2c89 req-e8e38e57-b52e-481e-bcfa-e775c82df99c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1849061746&fields=id&tenant_id=46a1cb48de6e4f43a563f40fd92f0bf0 HTTP/1.1" status: 200 len: 267 time: 0.0503211 Nov 18 18:25:12.419574 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af952840-e13f-47c0-b8d3-8e1b700c2c89 req-0a132878-c9ba-409d-bb6f-acc50bfbcebb tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:12.421175 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-af952840-e13f-47c0-b8d3-8e1b700c2c89 req-0a132878-c9ba-409d-bb6f-acc50bfbcebb tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 946 time: 0.0819454 Nov 18 18:25:12.428429 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a95777-1c8a-49b8-b0c1-a746ed28a818 req-1924fd72-b1d1-461d-8f53-b41937678560 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:12.429808 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-95a95777-1c8a-49b8-b0c1-a746ed28a818 req-1924fd72-b1d1-461d-8f53-b41937678560 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0853512 Nov 18 18:25:12.434976 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-af952840-e13f-47c0-b8d3-8e1b700c2c89 req-194ef4ca-44e8-4f9e-9631-73d0270ef31b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Request body: {'port': {'security_groups': ['dd5cdf9b-ed90-4f2d-90c9-38ebebf71969', '43932994-97a2-4b28-a8c8-cacaf8d0e5e6']}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:12.526350 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-af952840-e13f-47c0-b8d3-8e1b700c2c89 req-194ef4ca-44e8-4f9e-9631-73d0270ef31b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:12.531784 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-95a95777-1c8a-49b8-b0c1-a746ed28a818 req-86ba0d67-ae4f-49b7-8912-ab429458036c tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0937636 Nov 18 18:25:12.669362 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1105ceb-15a9-4a58-af11-236ab50340c4 req-73a9f468-dfde-4073-92e5-581deab69369 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:12.670855 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a1105ceb-15a9-4a58-af11-236ab50340c4 req-73a9f468-dfde-4073-92e5-581deab69369 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 946 time: 0.0816126 Nov 18 18:25:12.794478 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a1105ceb-15a9-4a58-af11-236ab50340c4 req-ce0fa4ac-7e65-48b5-badd-f529919e7333 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1076267 Nov 18 18:25:12.825325 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-af952840-e13f-47c0-b8d3-8e1b700c2c89 req-194ef4ca-44e8-4f9e-9631-73d0270ef31b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] For port e535328b-e6c3-4630-a314-5bd8ccdaad80, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:25:12.856417 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-934e7cc8-2f53-4907-9e8c-af4a74bf2fbc req-3a8b966c-6afb-4cc5-95ce-5e0dc9214d15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:12.858129 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-934e7cc8-2f53-4907-9e8c-af4a74bf2fbc req-3a8b966c-6afb-4cc5-95ce-5e0dc9214d15 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 1099 time: 0.0450714 Nov 18 18:25:12.863646 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-af952840-e13f-47c0-b8d3-8e1b700c2c89 req-194ef4ca-44e8-4f9e-9631-73d0270ef31b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:12.869859 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-af952840-e13f-47c0-b8d3-8e1b700c2c89 req-194ef4ca-44e8-4f9e-9631-73d0270ef31b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:12.888517 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['e535328b-e6c3-4630-a314-5bd8ccdaad80'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:25:12.915297 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af952840-e13f-47c0-b8d3-8e1b700c2c89 req-194ef4ca-44e8-4f9e-9631-73d0270ef31b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:12.915964 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-af952840-e13f-47c0-b8d3-8e1b700c2c89 req-194ef4ca-44e8-4f9e-9631-73d0270ef31b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:12.917420 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-af952840-e13f-47c0-b8d3-8e1b700c2c89 req-194ef4ca-44e8-4f9e-9631-73d0270ef31b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "PUT /v2.0/ports/e535328b-e6c3-4630-a314-5bd8ccdaad80 HTTP/1.1" status: 200 len: 982 time: 0.4867151 Nov 18 18:25:12.917972 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:25:12.920299 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-23f5970d-8de3-4145-b88e-1e78cbc9bfd7" -d '{"events": [{"name": "network-changed", "server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:25:12.928492 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-934e7cc8-2f53-4907-9e8c-af4a74bf2fbc req-2dec6087-8612-47f6-8259-dfd7b1401139 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505066 Nov 18 18:25:12.983495 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-194ef4ca-44e8-4f9e-9631-73d0270ef31b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event updated for resources: {'Port': ['ID=e535328b-e6c3-4630-a314-5bd8ccdaad80,revision_number=6']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:12.994996 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:25:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b249ea4-928f-41f8-a7a9-4e1cf0bcdbfc x-openstack-request-id: req-9b249ea4-928f-41f8-a7a9-4e1cf0bcdbfc {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:25:12.995707 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:25:12.995888 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-9b249ea4-928f-41f8-a7a9-4e1cf0bcdbfc {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:25:12.997326 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'status': 'completed', 'code': 200} Nov 18 18:25:13.076243 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['e535328b-e6c3-4630-a314-5bd8ccdaad80'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:25:13.174812 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9deea382-1f06-4af0-9366-36bd3b3324a9 req-282e8e5a-2ea0-4be8-9d32-8aca238e98be tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:13.177506 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9deea382-1f06-4af0-9366-36bd3b3324a9 req-282e8e5a-2ea0-4be8-9d32-8aca238e98be tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.1445696 Nov 18 18:25:13.222177 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-649940bc-d2ab-4d57-86b7-b6ca1dae8b5b req-e40689d2-eced-4372-8e3d-816f1af419a4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:13.231032 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-649940bc-d2ab-4d57-86b7-b6ca1dae8b5b req-e40689d2-eced-4372-8e3d-816f1af419a4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 946 time: 0.1434834 Nov 18 18:25:13.335128 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23f5970d-8de3-4145-b88e-1e78cbc9bfd7 req-d899db1b-cf29-4a5b-aa4f-f76d9324ed70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:13.338227 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-23f5970d-8de3-4145-b88e-1e78cbc9bfd7 req-d899db1b-cf29-4a5b-aa4f-f76d9324ed70 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=46a1cb48de6e4f43a563f40fd92f0bf0&device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 1138 time: 0.0844352 Nov 18 18:25:13.341253 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9deea382-1f06-4af0-9366-36bd3b3324a9 req-d506fbab-dbdb-4d5e-929e-5e5da16ccff7 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1550846 Nov 18 18:25:13.367959 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-649940bc-d2ab-4d57-86b7-b6ca1dae8b5b req-4aff7977-6e3f-4ad0-83e9-fca70220b29b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1235206 Nov 18 18:25:13.472886 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-2bba97cd-82b8-48f6-a752-816b6106278c None None] Provisioning complete for port e535328b-e6c3-4630-a314-5bd8ccdaad80 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:25:13.473102 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-2bba97cd-82b8-48f6-a752-816b6106278c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:13.502199 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23f5970d-8de3-4145-b88e-1e78cbc9bfd7 req-1722b2ad-dbd8-4122-9e2c-24437555f781 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:13.504152 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-23f5970d-8de3-4145-b88e-1e78cbc9bfd7 req-1722b2ad-dbd8-4122-9e2c-24437555f781 service neutron] 10.222.0.31 "GET /v2.0/networks?id=c5332eb5-c186-4bcf-89d9-eb78be973548 HTTP/1.1" status: 200 len: 917 time: 0.1511047 Nov 18 18:25:13.621585 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-23f5970d-8de3-4145-b88e-1e78cbc9bfd7 req-dad7379b-56d6-41b6-9c6b-81c6a071cd21 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80 HTTP/1.1" status: 200 len: 1002 time: 0.0739355 Nov 18 18:25:13.670087 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f07b4c-b055-4e8a-8e77-239a7e18484f req-8ca73d91-d77c-4ef2-b8b4-0444f1821031 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:13.671699 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f9f07b4c-b055-4e8a-8e77-239a7e18484f req-8ca73d91-d77c-4ef2-b8b4-0444f1821031 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0557878 Nov 18 18:25:13.704657 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23f5970d-8de3-4145-b88e-1e78cbc9bfd7 req-7123b299-786d-472d-8504-5a4830a6d0ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:13.713515 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-23f5970d-8de3-4145-b88e-1e78cbc9bfd7 req-7123b299-786d-472d-8504-5a4830a6d0ad service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24097eeb-7eeb-4617-b83d-a363de5de9b1 HTTP/1.1" status: 200 len: 854 time: 0.0774539 Nov 18 18:25:13.728247 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f9f07b4c-b055-4e8a-8e77-239a7e18484f req-af2e6a1c-441d-4aa1-bbc4-9f99a932fece tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492978 Nov 18 18:25:13.807844 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23f5970d-8de3-4145-b88e-1e78cbc9bfd7 req-dc5790da-7068-421a-8956-4382a0fbfa80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:13.809386 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-23f5970d-8de3-4145-b88e-1e78cbc9bfd7 req-dc5790da-7068-421a-8956-4382a0fbfa80 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c5332eb5-c186-4bcf-89d9-eb78be973548&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0745907 Nov 18 18:25:13.933866 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-23f5970d-8de3-4145-b88e-1e78cbc9bfd7 req-8eb9cb83-2aa1-4895-b697-c5884dbf2144 service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0911357 Nov 18 18:25:14.033455 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-23f5970d-8de3-4145-b88e-1e78cbc9bfd7 req-8f706319-9755-4c93-9a34-87214db1b599 service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852640 Nov 18 18:25:14.485305 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87237c0f-b23c-476d-82b7-a3e288981ba4 req-eb7eafe6-a560-42dc-8ed2-79b2b8483b23 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:14.486784 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-87237c0f-b23c-476d-82b7-a3e288981ba4 req-eb7eafe6-a560-42dc-8ed2-79b2b8483b23 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 946 time: 0.0533030 Nov 18 18:25:14.534662 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-87237c0f-b23c-476d-82b7-a3e288981ba4 req-e135b3e1-1459-4873-8d37-9330da614bdf tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412159 Nov 18 18:25:14.867580 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58b40975-0248-4d53-a7ad-cc1c3b59392b req-d7a07d9f-9564-4df6-a602-60e37b1024f7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:14.869178 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58b40975-0248-4d53-a7ad-cc1c3b59392b req-d7a07d9f-9564-4df6-a602-60e37b1024f7 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0532217 Nov 18 18:25:14.923879 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58b40975-0248-4d53-a7ad-cc1c3b59392b req-13b3aad3-b321-4769-95e7-4c580488fa57 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471280 Nov 18 18:25:15.657209 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2924579-4111-4ca9-af1e-9c32d3bb978a req-6ddaddf0-da74-43c7-bae6-0cc3345da2c5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:15.658807 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a2924579-4111-4ca9-af1e-9c32d3bb978a req-6ddaddf0-da74-43c7-bae6-0cc3345da2c5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 946 time: 0.0483804 Nov 18 18:25:15.711002 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a2924579-4111-4ca9-af1e-9c32d3bb978a req-1eea0e42-0e96-490e-955b-7215843ad967 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456550 Nov 18 18:25:16.038480 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22de2122-2a48-4acf-a5da-233969bc3cbe req-9633c2e0-32fa-4d3f-8e6e-c475fae72dbd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:16.039956 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22de2122-2a48-4acf-a5da-233969bc3cbe req-9633c2e0-32fa-4d3f-8e6e-c475fae72dbd tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0475118 Nov 18 18:25:16.086460 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22de2122-2a48-4acf-a5da-233969bc3cbe req-493b04d8-af30-408f-a65f-80f8f9503963 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/security-groups?id=5863b35d-efcf-4c6a-af3b-35250e4eb224&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404387 Nov 18 18:25:16.526401 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdabc273-ccf0-4082-ad74-f07700733d46 req-ec0c0ad6-0782-4a19-b65c-ba4181c70d7d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:16.527958 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cdabc273-ccf0-4082-ad74-f07700733d46 req-ec0c0ad6-0782-4a19-b65c-ba4181c70d7d tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.31 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 945 time: 0.0471787 Nov 18 18:25:16.628724 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [req-cdabc273-ccf0-4082-ad74-f07700733d46 req-cbf6be04-a5ce-47f0-9d0e-21af5e0e8ff4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Deleting port b627bee7-04b0-4a31-8ff0-84f976c65917 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:25:16.629060 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-cdabc273-ccf0-4082-ad74-f07700733d46 req-cbf6be04-a5ce-47f0-9d0e-21af5e0e8ff4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:16.716614 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-cdabc273-ccf0-4082-ad74-f07700733d46 req-cbf6be04-a5ce-47f0-9d0e-21af5e0e8ff4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] For port b627bee7-04b0-4a31-8ff0-84f976c65917, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b627bee7-04b0-4a31-8ff0-84f976c65917,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:25:16.716970 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-cdabc273-ccf0-4082-ad74-f07700733d46 req-cbf6be04-a5ce-47f0-9d0e-21af5e0e8ff4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:16.734474 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [req-cdabc273-ccf0-4082-ad74-f07700733d46 req-cbf6be04-a5ce-47f0-9d0e-21af5e0e8ff4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Calling delete_port for b627bee7-04b0-4a31-8ff0-84f976c65917 owned by compute:nova {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:25:16.860906 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-cdabc273-ccf0-4082-ad74-f07700733d46 req-cbf6be04-a5ce-47f0-9d0e-21af5e0e8ff4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:16.872633 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['b627bee7-04b0-4a31-8ff0-84f976c65917'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:25:16.892558 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbf6be04-a5ce-47f0-9d0e-21af5e0e8ff4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Pushing event deleted for resources: {'Port': ['ID=b627bee7-04b0-4a31-8ff0-84f976c65917,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:16.935357 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-cdabc273-ccf0-4082-ad74-f07700733d46 req-cbf6be04-a5ce-47f0-9d0e-21af5e0e8ff4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] No DVR routers for this DVR port b627bee7-04b0-4a31-8ff0-84f976c65917 on host hv-cinder-78776 {{(pid=102688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:25:16.937856 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-cdabc273-ccf0-4082-ad74-f07700733d46 req-cbf6be04-a5ce-47f0-9d0e-21af5e0e8ff4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:16.941199 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-cdabc273-ccf0-4082-ad74-f07700733d46 req-cbf6be04-a5ce-47f0-9d0e-21af5e0e8ff4 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.31 "DELETE /v2.0/ports/b627bee7-04b0-4a31-8ff0-84f976c65917 HTTP/1.1" status: 204 len: 173 time: 0.4051435 Nov 18 18:25:16.941640 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cd7419e5-272b-4c8a-a4a2-9b75dc0b9400', 'name': 'network-vif-deleted', 'tag': 'b627bee7-04b0-4a31-8ff0-84f976c65917'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:25:16.943863 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f467fb80-f0eb-4969-95ca-c222809b1a08" -d '{"events": [{"server_uuid": "cd7419e5-272b-4c8a-a4a2-9b75dc0b9400", "name": "network-vif-deleted", "tag": "b627bee7-04b0-4a31-8ff0-84f976c65917"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:25:16.982145 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:25:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ce3ddaa-3665-43c5-b3fa-4feb56362989 x-openstack-request-id: req-3ce3ddaa-3665-43c5-b3fa-4feb56362989 {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:25:16.982447 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cd7419e5-272b-4c8a-a4a2-9b75dc0b9400", "name": "network-vif-deleted", "tag": "b627bee7-04b0-4a31-8ff0-84f976c65917", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:25:16.982706 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-3ce3ddaa-3665-43c5-b3fa-4feb56362989 {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:25:16.983102 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cd7419e5-272b-4c8a-a4a2-9b75dc0b9400', 'name': 'network-vif-deleted', 'tag': 'b627bee7-04b0-4a31-8ff0-84f976c65917', 'status': 'completed', 'code': 200} Nov 18 18:25:17.194989 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8e51fe4c-f194-4f9c-97ef-ce827065f7a1 req-051a85b9-ea0e-4284-bd60-9d9df73ecdc1 tempest-ServerRescueNegativeTestJSON-294216932 tempest-ServerRescueNegativeTestJSON-294216932-project] 10.222.0.82 "GET /v2.0/ports?device_id=cd7419e5-272b-4c8a-a4a2-9b75dc0b9400 HTTP/1.1" status: 200 len: 210 time: 0.0261390 Nov 18 18:25:18.256112 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41926) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:18.878681 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fc5d2e79-cd58-4551-a8d5-48b9d7c263b5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-499121'] for router_interface, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:19.166434 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-fc5d2e79-cd58-4551-a8d5-48b9d7c263b5 admin admin] Deleting port f8c0b26a-5115-4ebd-840b-187eb8ac41ea {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:25:19.166765 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fc5d2e79-cd58-4551-a8d5-48b9d7c263b5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:19.246423 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-fc5d2e79-cd58-4551-a8d5-48b9d7c263b5 admin admin] For port f8c0b26a-5115-4ebd-840b-187eb8ac41ea, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=f8c0b26a-5115-4ebd-840b-187eb8ac41ea,segment=NetworkSegment(fc75aa15-d703-4ab9-a6cc-28e47f3895ec),segment_id=fc75aa15-d703-4ab9-a6cc-28e47f3895ec)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:25:19.246917 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fc5d2e79-cd58-4551-a8d5-48b9d7c263b5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:19.260496 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-fc5d2e79-cd58-4551-a8d5-48b9d7c263b5 admin admin] Calling delete_port for f8c0b26a-5115-4ebd-840b-187eb8ac41ea owned by network:router_interface {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:25:19.442853 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fc5d2e79-cd58-4551-a8d5-48b9d7c263b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:19.468422 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc5d2e79-cd58-4551-a8d5-48b9d7c263b5 admin admin] Pushing event deleted for resources: {'Port': ['ID=f8c0b26a-5115-4ebd-840b-187eb8ac41ea,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:19.640451 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fc5d2e79-cd58-4551-a8d5-48b9d7c263b5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1772491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-498973'] for router_interface, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:19.857501 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc5d2e79-cd58-4551-a8d5-48b9d7c263b5 admin admin] Router 89023a45-fdd3-4072-a54e-c2f1bb2139ce has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:25:19.859394 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41958) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:19.966774 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc5d2e79-cd58-4551-a8d5-48b9d7c263b5 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:25:19.969545 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6f08e7ae-4185-4186-b3f4-d5e2c5948acc admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:19.973912 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-fc5d2e79-cd58-4551-a8d5-48b9d7c263b5 admin admin] 10.222.0.82 "PUT /v2.0/routers/89023a45-fdd3-4072-a54e-c2f1bb2139ce/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7156999 Nov 18 18:25:19.975495 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41962) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:19.978824 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fd52dc7-b510-4bbd-9831-98d3b460b113 None None] Sync routers for ids ['89023a45-fdd3-4072-a54e-c2f1bb2139ce'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:25:19.990729 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fd52dc7-b510-4bbd-9831-98d3b460b113 None None] Routers {'89023a45-fdd3-4072-a54e-c2f1bb2139ce'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:25:19.991682 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-9fd52dc7-b510-4bbd-9831-98d3b460b113 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:25:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['89023a45-fdd3-4072-a54e-c2f1bb2139ce'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:20.063840 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6f08e7ae-4185-4186-b3f4-d5e2c5948acc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.070617 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6f08e7ae-4185-4186-b3f4-d5e2c5948acc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.086438 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Publish callbacks [] for router, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.109450 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-9fd52dc7-b510-4bbd-9831-98d3b460b113 None None] Set router 89023a45-fdd3-4072-a54e-c2f1bb2139ce gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:25:20.116441 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-6f08e7ae-4185-4186-b3f4-d5e2c5948acc admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=825cb63ead51471ea556a541425cb61d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2558742 Nov 18 18:25:20.119111 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41966) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:20.125498 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f08e7ae-4185-4186-b3f4-d5e2c5948acc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ff34a65-6e8c-4699-8c69-4e3966c11b9f,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:20.176514 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-12c767c6-8e01-472d-b6d0-50ab467ba78a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.198654 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-12c767c6-8e01-472d-b6d0-50ab467ba78a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.199791 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.274041 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Deleting port 302efbee-d2dc-4e73-be12-9573a5e7a62f {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:25:20.274733 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.286810 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-12c767c6-8e01-472d-b6d0-50ab467ba78a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.291198 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-12c767c6-8e01-472d-b6d0-50ab467ba78a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.294840 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-12c767c6-8e01-472d-b6d0-50ab467ba78a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8ff34a65-6e8c-4699-8c69-4e3966c11b9f HTTP/1.1" status: 204 len: 168 time: 0.1723509 Nov 18 18:25:20.306483 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12c767c6-8e01-472d-b6d0-50ab467ba78a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ff34a65-6e8c-4699-8c69-4e3966c11b9f,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:20.329109 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-9fd52dc7-b510-4bbd-9831-98d3b460b113 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'name': 'tempest-ServerRescueNegativeTestJSON-1249927654-router', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212'}], 'enable_snat': True}, 'gw_port_id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:13Z', 'updated_at': '2021-11-18T18:25:19Z', 'revision_number': 5, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'gw_port': {'id': '302efbee-d2dc-4e73-be12-9573a5e7a62f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5f:e7:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:15Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:20.377752 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fd52dc7-b510-4bbd-9831-98d3b460b113 None None] Checking router: 89023a45-fdd3-4072-a54e-c2f1bb2139ce for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:25:20.386679 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fd52dc7-b510-4bbd-9831-98d3b460b113 None None] Routers {'89023a45-fdd3-4072-a54e-c2f1bb2139ce'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:25:20.387289 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-9fd52dc7-b510-4bbd-9831-98d3b460b113 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:25:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['89023a45-fdd3-4072-a54e-c2f1bb2139ce'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:20.387641 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] For port 302efbee-d2dc-4e73-be12-9573a5e7a62f, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=302efbee-d2dc-4e73-be12-9573a5e7a62f,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:25:20.388085 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.402914 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Calling delete_port for 302efbee-d2dc-4e73-be12-9573a5e7a62f owned by network:router_gateway {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:25:20.479296 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-9fd52dc7-b510-4bbd-9831-98d3b460b113 None None] Set router 89023a45-fdd3-4072-a54e-c2f1bb2139ce gateway port host: None {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:25:20.535659 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-9fd52dc7-b510-4bbd-9831-98d3b460b113 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'name': 'tempest-ServerRescueNegativeTestJSON-1249927654-router', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:13Z', 'updated_at': '2021-11-18T18:25:20Z', 'revision_number': 6, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'gw_port_host': None}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:20.569322 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fd52dc7-b510-4bbd-9831-98d3b460b113 None None] The sync data for ids ['89023a45-fdd3-4072-a54e-c2f1bb2139ce'] in dv-cinder-787764-6-iscsi is: [{'id': '89023a45-fdd3-4072-a54e-c2f1bb2139ce', 'name': 'tempest-ServerRescueNegativeTestJSON-1249927654-router', 'tenant_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:13Z', 'updated_at': '2021-11-18T18:25:20Z', 'revision_number': 6, 'project_id': '76c33c7e96d748ee9e7cdd35c33082fa', 'gw_port_host': None}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:25:20.577402 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.605797 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Pushing event deleted for resources: {'Port': ['ID=302efbee-d2dc-4e73-be12-9573a5e7a62f,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:20.615724 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:20.616097 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:20.616439 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:20.616824 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:20.617148 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:20.617827 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:20.617827 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:20.618091 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:20.618413 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:20.618732 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:20.619052 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:20.619463 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:20.639288 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41972) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:20.653054 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2ee262d1-71f7-4d20-80d1-47d7f1bdb9d6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.685495 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-500475'] for router_gateway, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.730194 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2ee262d1-71f7-4d20-80d1-47d7f1bdb9d6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.734712 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2ee262d1-71f7-4d20-80d1-47d7f1bdb9d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.774927 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-2ee262d1-71f7-4d20-80d1-47d7f1bdb9d6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=52ff639828f240e5957deb76257ef688&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1345117 Nov 18 18:25:20.776589 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee262d1-71f7-4d20-80d1-47d7f1bdb9d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=690dbc35-aa20-48a9-b239-8db6c7001db6,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:20.778356 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41976) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:20.814889 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-430336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-557'] for router, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.814889 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.836976 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-95ee362b-1596-46e3-a32f-6f69de7088a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.859054 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-95ee362b-1596-46e3-a32f-6f69de7088a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.879781 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-430347'] for router, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.880344 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 89023a45-fdd3-4072-a54e-c2f1bb2139ce {{(pid=102689) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 18:25:20.885949 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] Publish callbacks [] for router, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.887109 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-1c294571-c245-446a-abaa-ef14855ac139 admin admin] 10.222.0.82 "DELETE /v2.0/routers/89023a45-fdd3-4072-a54e-c2f1bb2139ce HTTP/1.1" status: 204 len: 168 time: 0.9099274 Nov 18 18:25:20.889701 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41978) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:20.919260 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-95ee362b-1596-46e3-a32f-6f69de7088a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.922261 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-95ee362b-1596-46e3-a32f-6f69de7088a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:20.925902 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-95ee362b-1596-46e3-a32f-6f69de7088a8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/690dbc35-aa20-48a9-b239-8db6c7001db6 HTTP/1.1" status: 204 len: 168 time: 0.1441357 Nov 18 18:25:20.932203 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95ee362b-1596-46e3-a32f-6f69de7088a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=690dbc35-aa20-48a9-b239-8db6c7001db6,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:21.130700 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.164534 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_v2 [None req-319db768-1eff-43f6-80f9-13518e9139cc admin admin] Deleting subnet 96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 {{(pid=102689) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:25:21.167719 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-319db768-1eff-43f6-80f9-13518e9139cc admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.202072 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-319db768-1eff-43f6-80f9-13518e9139cc admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12724830'] for subnet, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.241635 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-319db768-1eff-43f6-80f9-13518e9139cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.293946 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-319db768-1eff-43f6-80f9-13518e9139cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12723963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14479099'] for subnet, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.310997 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41986) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:21.322341 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-319db768-1eff-43f6-80f9-13518e9139cc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:21.324172 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-319db768-1eff-43f6-80f9-13518e9139cc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.327642 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-319db768-1eff-43f6-80f9-13518e9139cc admin admin] 10.222.0.82 "DELETE /v2.0/subnets/96a4b79e-38e8-4bbc-a0f7-ac6066ef30c4 HTTP/1.1" status: 204 len: 168 time: 0.4369857 Nov 18 18:25:21.328247 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6edff295-2e06-41d6-9ab9-0249ed4c728a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.331037 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 41988) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:21.416013 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.418031 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6edff295-2e06-41d6-9ab9-0249ed4c728a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.422415 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6edff295-2e06-41d6-9ab9-0249ed4c728a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.466686 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-6edff295-2e06-41d6-9ab9-0249ed4c728a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=748cf9d35fae4a36a6727a40abad6f11&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1519268 Nov 18 18:25:21.467145 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41990) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:21.473224 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6edff295-2e06-41d6-9ab9-0249ed4c728a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d348b9d-d96d-422e-bfab-846126112b6d,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:21.504962 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.521130 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6873ba7e-c2b1-46cd-a8ad-912649e9092a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.526607 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3c8d9a8a-b5ab-438f-b6ad-3b4724905e38']}} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:21.535747 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec') {'for_net_delete': True} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:21.536079 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fc75aa15-d703-4ab9-a6cc-28e47f3895ec') {} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:21.542981 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6873ba7e-c2b1-46cd-a8ad-912649e9092a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.545162 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12724807'] for segment, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.562256 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.570795 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] Releasing vlan 1343 on physical network physnet1 to pool {{(pid=102689) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:25:21.571236 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12723877'] for segment, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: Traceback (most recent call last): Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: timer() Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: cb(*args, **kw) Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: return func(*args, **kwargs) Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: self._notify() Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: self.callback(batched_events) Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: event.method(event) Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: return f(self, *a, **k) Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._get(url).json() Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: return self.request(url, 'GET', **kwargs) Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:25:21.573895 dv-cinder-787764-6-iscsi neutron-server[102689]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:25:21.600877 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6873ba7e-c2b1-46cd-a8ad-912649e9092a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.603527 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6873ba7e-c2b1-46cd-a8ad-912649e9092a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.607576 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-6873ba7e-c2b1-46cd-a8ad-912649e9092a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3d348b9d-d96d-422e-bfab-846126112b6d HTTP/1.1" status: 204 len: 168 time: 0.1367404 Nov 18 18:25:21.613568 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6873ba7e-c2b1-46cd-a8ad-912649e9092a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d348b9d-d96d-422e-bfab-846126112b6d,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:21.645702 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.655058 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.659633 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] 10.222.0.82 "DELETE /v2.0/networks/3c8d9a8a-b5ab-438f-b6ad-3b4724905e38 HTTP/1.1" status: 204 len: 168 time: 0.3271513 Nov 18 18:25:21.673634 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2ff533f-197d-4f5c-a195-434ab33d98be admin admin] Pushing event deleted for resources: {'Network': ['ID=3c8d9a8a-b5ab-438f-b6ad-3b4724905e38,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:21.740981 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b627bee7-04b0-4a31-8ff0-84f976c65917 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:25:21.762776 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: b627bee7-04b0-4a31-8ff0-84f976c65917 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:25:21.763818 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b627bee7-04b0-4a31-8ff0-84f976c65917 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:25:21.851565 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 41998) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:21.912559 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-1fe94b55-38bf-4aed-92ab-1392a8787972 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=76c33c7e96d748ee9e7cdd35c33082fa&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0597332 Nov 18 18:25:21.915121 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 42000) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:21.972916 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6bfea706-a52a-41fd-bf48-8dfe7f95e2e5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:21.995364 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6bfea706-a52a-41fd-bf48-8dfe7f95e2e5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:22.042017 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6bfea706-a52a-41fd-bf48-8dfe7f95e2e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:22.044701 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6bfea706-a52a-41fd-bf48-8dfe7f95e2e5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:22.045864 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-6bfea706-a52a-41fd-bf48-8dfe7f95e2e5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5863b35d-efcf-4c6a-af3b-35250e4eb224 HTTP/1.1" status: 204 len: 168 time: 0.1298027 Nov 18 18:25:22.053970 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bfea706-a52a-41fd-bf48-8dfe7f95e2e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5863b35d-efcf-4c6a-af3b-35250e4eb224,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:22.293958 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device f8c0b26a-5115-4ebd-840b-187eb8ac41ea no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:25:22.316740 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: f8c0b26a-5115-4ebd-840b-187eb8ac41ea {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:25:22.317087 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device f8c0b26a-5115-4ebd-840b-187eb8ac41ea not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:25:22.317700 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 302efbee-d2dc-4e73-be12-9573a5e7a62f no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:25:22.337386 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 302efbee-d2dc-4e73-be12-9573a5e7a62f {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:25:22.337733 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 302efbee-d2dc-4e73-be12-9573a5e7a62f not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:25:31.260147 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42148) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:31.371050 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-34afc460-98db-499e-aa25-4793fa9d9a16 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:31.447420 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-34afc460-98db-499e-aa25-4793fa9d9a16 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:31.450991 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-34afc460-98db-499e-aa25-4793fa9d9a16 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:31.487662 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-34afc460-98db-499e-aa25-4793fa9d9a16 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=93ac6624355a41b79f347c571c6dc06c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2265501 Nov 18 18:25:31.489673 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34afc460-98db-499e-aa25-4793fa9d9a16 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6faa67d0-54df-48ef-884c-dc74c670af2a,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:31.490351 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 42154) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:31.539005 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9e8fca80-9eff-4db2-9d7d-3533c0976087 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:31.559310 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9e8fca80-9eff-4db2-9d7d-3533c0976087 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:31.605552 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9e8fca80-9eff-4db2-9d7d-3533c0976087 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:31.608160 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9e8fca80-9eff-4db2-9d7d-3533c0976087 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:31.609309 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-9e8fca80-9eff-4db2-9d7d-3533c0976087 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6faa67d0-54df-48ef-884c-dc74c670af2a HTTP/1.1" status: 204 len: 168 time: 0.1178627 Nov 18 18:25:31.616471 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e8fca80-9eff-4db2-9d7d-3533c0976087 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6faa67d0-54df-48ef-884c-dc74c670af2a,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:33.151453 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 42206) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:33.259205 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bce90b84-c399-45f8-95d8-6cba5c695e8f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.333633 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bce90b84-c399-45f8-95d8-6cba5c695e8f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.337177 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bce90b84-c399-45f8-95d8-6cba5c695e8f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.372903 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce90b84-c399-45f8-95d8-6cba5c695e8f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=990e09e5-d103-40f5-a573-43fce112ed25,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:33.380485 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-bce90b84-c399-45f8-95d8-6cba5c695e8f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=162fd5aed7024b659e63cfb2a7be679f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2272286 Nov 18 18:25:33.380905 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42212) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:33.429181 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5e3f11b8-0fdf-4fea-8c08-b2863916cc10 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.451577 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5e3f11b8-0fdf-4fea-8c08-b2863916cc10 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.496197 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5e3f11b8-0fdf-4fea-8c08-b2863916cc10 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.498918 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5e3f11b8-0fdf-4fea-8c08-b2863916cc10 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.500096 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-5e3f11b8-0fdf-4fea-8c08-b2863916cc10 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/990e09e5-d103-40f5-a573-43fce112ed25 HTTP/1.1" status: 204 len: 168 time: 0.1174288 Nov 18 18:25:33.508306 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e3f11b8-0fdf-4fea-8c08-b2863916cc10 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=990e09e5-d103-40f5-a573-43fce112ed25,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:33.748703 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42218) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:33.761546 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b9d6c8c-9b39-4089-9394-3babc75ce718 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.831828 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b9d6c8c-9b39-4089-9394-3babc75ce718 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.835225 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b9d6c8c-9b39-4089-9394-3babc75ce718 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.875332 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-9b9d6c8c-9b39-4089-9394-3babc75ce718 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9578f40f010348059a3edb57e72a340c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1255484 Nov 18 18:25:33.876227 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b9d6c8c-9b39-4089-9394-3babc75ce718 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25fc6e50-e6b8-4944-a49a-d46928b1a131,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:33.878037 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 42220) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:33.925404 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-758f97e4-d678-40b3-81b1-322736f2a3af admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.946429 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-758f97e4-d678-40b3-81b1-322736f2a3af admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.985482 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1aa8a5d7-9c5e-43a9-916d-5110641328ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.992965 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-758f97e4-d678-40b3-81b1-322736f2a3af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.995621 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-758f97e4-d678-40b3-81b1-322736f2a3af admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:33.996879 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-758f97e4-d678-40b3-81b1-322736f2a3af admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/25fc6e50-e6b8-4944-a49a-d46928b1a131 HTTP/1.1" status: 204 len: 168 time: 0.1178250 Nov 18 18:25:34.004885 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-758f97e4-d678-40b3-81b1-322736f2a3af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25fc6e50-e6b8-4944-a49a-d46928b1a131,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:34.632309 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 42244) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:34.725563 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1769454232-network', 'tenant_id': '8502b10e2ed542cfa5c2b87f6e75c28e'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:34.746678 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Made reservation on behalf of 8502b10e2ed542cfa5c2b87f6e75c28e for: {'network': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:25:34.749227 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:34.757208 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:34.834273 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:34.838304 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:34.863568 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1308} {{(pid=102688) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:25:34.873965 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9bc305b-9d94-44c9-bbd3-80aecdf9db76,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:34.879804 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:34.880181 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.segments_db [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Added segment f2c05c1e-fc3a-498a-a2ce-e857ead7ffa3 of type vlan for network b6a3f2aa-a0f5-4706-b055-920feb448410 Nov 18 18:25:34.920361 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:34.949390 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:34.950515 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:34.951172 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:34.988899 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 899 time: 0.3548884 Nov 18 18:25:34.991794 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42248) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:34.996889 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-f3a6a527-38f7-4122-873a-b3b3fb2e3398 admin admin] Request body: {'subnet': {'network_id': 'b6a3f2aa-a0f5-4706-b055-920feb448410', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1769454232-subnet', 'tenant_id': '8502b10e2ed542cfa5c2b87f6e75c28e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:35.017646 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3a6a527-38f7-4122-873a-b3b3fb2e3398 admin admin] Made reservation on behalf of 8502b10e2ed542cfa5c2b87f6e75c28e for: {'subnet': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:25:35.019942 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3a6a527-38f7-4122-873a-b3b3fb2e3398 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14479070'] for subnet, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:35.027510 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea355ec-0747-4d31-9fca-a97c48b83c8c admin admin] Pushing event updated for resources: {'Network': ['ID=b6a3f2aa-a0f5-4706-b055-920feb448410,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:35.040057 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network b6a3f2aa-a0f5-4706-b055-920feb448410 details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:25:35.069918 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-147dd31f-d7d6-4084-94f0-aad11a5bbc7d req-eb8b6dea-6a17-4a1e-95e5-e4c01a34200e service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0500941 Nov 18 18:25:35.143243 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-147dd31f-d7d6-4084-94f0-aad11a5bbc7d req-0730d8e3-bd08-4135-a14a-3f458c659bce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:35.144877 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-147dd31f-d7d6-4084-94f0-aad11a5bbc7d req-0730d8e3-bd08-4135-a14a-3f458c659bce service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 1099 time: 0.0401089 Nov 18 18:25:35.198433 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3a6a527-38f7-4122-873a-b3b3fb2e3398 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-12723770', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14479088'] for subnet, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:35.260846 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a6a527-38f7-4122-873a-b3b3fb2e3398 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3ff6b3dc-d0ec-4376-9f06-6b97dedae0f7,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:35.263795 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3a6a527-38f7-4122-873a-b3b3fb2e3398 admin admin] Checking segment: {'id': 'f2c05c1e-fc3a-498a-a2ce-e857ead7ffa3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1308, 'network_id': 'b6a3f2aa-a0f5-4706-b055-920feb448410'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:25:35.264180 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3a6a527-38f7-4122-873a-b3b3fb2e3398 admin admin] Network hostable DHCP agents. Network: b6a3f2aa-a0f5-4706-b055-920feb448410, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102689) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:25:35.270478 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-147dd31f-d7d6-4084-94f0-aad11a5bbc7d req-57373c7e-11ce-435d-9013-6a5802a42325 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:35.271958 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-147dd31f-d7d6-4084-94f0-aad11a5bbc7d req-57373c7e-11ce-435d-9013-6a5802a42325 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 919 time: 0.0908113 Nov 18 18:25:35.281347 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3a6a527-38f7-4122-873a-b3b3fb2e3398 admin admin] Network b6a3f2aa-a0f5-4706-b055-920feb448410 is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102689) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:25:35.290174 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-f3a6a527-38f7-4122-873a-b3b3fb2e3398 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, b6a3f2aa-a0f5-4706-b055-920feb448410) {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:25:35.294603 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3a6a527-38f7-4122-873a-b3b3fb2e3398 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:35.295346 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3a6a527-38f7-4122-873a-b3b3fb2e3398 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:35.302733 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-394bf9f1-7582-4ad4-8c32-9457e01a0713 None None] Network b6a3f2aa-a0f5-4706-b055-920feb448410 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:25:35.315326 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-f3a6a527-38f7-4122-873a-b3b3fb2e3398 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.3218892 Nov 18 18:25:35.351889 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-147dd31f-d7d6-4084-94f0-aad11a5bbc7d req-737fdb15-0a7a-4b76-927d-b52306f27c81 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b8ded38f-97b4-485b-9845-705c1fb9701d HTTP/1.1" status: 200 len: 1001 time: 0.0648711 Nov 18 18:25:35.404895 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-147dd31f-d7d6-4084-94f0-aad11a5bbc7d req-62ca113e-c1be-4730-8c6b-73a3b2eb2191 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:35.406371 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-147dd31f-d7d6-4084-94f0-aad11a5bbc7d req-62ca113e-c1be-4730-8c6b-73a3b2eb2191 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 200 len: 856 time: 0.0464776 Nov 18 18:25:35.434768 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9daf9743-bbb4-43c5-8f49-386dced0b8df None None] Network b6a3f2aa-a0f5-4706-b055-920feb448410 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:25:35.470768 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-147dd31f-d7d6-4084-94f0-aad11a5bbc7d req-0c609d11-af60-471f-b0b1-fe515153331c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:35.473071 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-147dd31f-d7d6-4084-94f0-aad11a5bbc7d req-0c609d11-af60-471f-b0b1-fe515153331c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d845755f-6a59-4935-8123-1a70c6e45968&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0476949 Nov 18 18:25:35.595012 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-147dd31f-d7d6-4084-94f0-aad11a5bbc7d req-69f803cf-bee2-44d8-8ee2-9af22cf29cf3 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1062913 Nov 18 18:25:35.709893 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-147dd31f-d7d6-4084-94f0-aad11a5bbc7d req-83dce7ac-93a7-47f5-b25a-334517a3648f service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1032643 Nov 18 18:25:35.831810 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42268) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:35.836753 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1087198063-network', 'tenant_id': '5a6c9d8e5e7e44759fe9bb50421958ad'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:35.856175 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Made reservation on behalf of 5a6c9d8e5e7e44759fe9bb50421958ad for: {'network': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:25:35.858366 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:35.867537 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:35.938934 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:35.942799 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:35.963979 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1307} {{(pid=102689) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:25:35.977772 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4b350c7-195b-47e3-b6d6-6e29d692eb48,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:35.982926 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:35.983260 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.segments_db [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Added segment 52d24af3-4f1e-40d4-8643-630614866152 of type vlan for network b6befa18-580b-4d26-a7cb-c89ee66a86c4 Nov 18 18:25:36.025524 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.049650 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.050582 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:36.051164 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.083860 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 899 time: 0.2508798 Nov 18 18:25:36.086938 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 42272) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:36.092011 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Request body: {'subnet': {'network_id': 'b6befa18-580b-4d26-a7cb-c89ee66a86c4', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1087198063-subnet', 'tenant_id': '5a6c9d8e5e7e44759fe9bb50421958ad', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:25:36.114007 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3224485-5bda-4cff-908c-7909ebc8decf admin admin] Pushing event updated for resources: {'Network': ['ID=b6befa18-580b-4d26-a7cb-c89ee66a86c4,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:36.116620 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Made reservation on behalf of 5a6c9d8e5e7e44759fe9bb50421958ad for: {'subnet': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:25:36.119619 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14505870'] for subnet, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.124834 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network b6befa18-580b-4d26-a7cb-c89ee66a86c4 details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:25:36.294535 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-13993069', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14505888'] for subnet, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.351384 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1c5bd7dc-b2c3-460e-b1d5-2e325e79b526,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:36.359231 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Checking segment: {'id': '52d24af3-4f1e-40d4-8643-630614866152', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': 'b6befa18-580b-4d26-a7cb-c89ee66a86c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:25:36.359583 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Network hostable DHCP agents. Network: b6befa18-580b-4d26-a7cb-c89ee66a86c4, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102688) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:25:36.363201 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:36.363548 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:36.363888 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:36.364253 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:36.364582 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:36.364910 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:36.365237 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:36.365562 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:36.365884 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:36.366204 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:36.366523 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:36.366840 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:25:36.382760 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Network b6befa18-580b-4d26-a7cb-c89ee66a86c4 is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102688) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:25:36.391299 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, b6befa18-580b-4d26-a7cb-c89ee66a86c4) {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:25:36.395796 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:36.396411 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.401268 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fe28799-31dd-415e-969b-769ae5b05686 None None] Network b6befa18-580b-4d26-a7cb-c89ee66a86c4 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:25:36.413121 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-5590b6c5-6b8c-4e94-9442-06bc1e7a9bf5 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.3249331 Nov 18 18:25:36.470320 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-ca47adfb-7931-436c-bfd4-4e043b99d5f2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.528450 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42276) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:36.540581 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4602eb7a-0604-400e-9770-a83f3701d028 None None] Network b6befa18-580b-4d26-a7cb-c89ee66a86c4 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:25:36.575727 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_v2 [None req-cce79bc3-5e0e-4881-a0fe-4fb5473a615c admin admin] Deleting subnet 3ff6b3dc-d0ec-4376-9f06-6b97dedae0f7 {{(pid=102689) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:25:36.579121 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-cce79bc3-5e0e-4881-a0fe-4fb5473a615c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.625233 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-cce79bc3-5e0e-4881-a0fe-4fb5473a615c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12724830'] for subnet, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.669015 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-cce79bc3-5e0e-4881-a0fe-4fb5473a615c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.724292 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-cce79bc3-5e0e-4881-a0fe-4fb5473a615c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12723963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14479099'] for subnet, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.747335 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cce79bc3-5e0e-4881-a0fe-4fb5473a615c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3ff6b3dc-d0ec-4376-9f06-6b97dedae0f7,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:36.753004 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-cce79bc3-5e0e-4881-a0fe-4fb5473a615c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.756251 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-cce79bc3-5e0e-4881-a0fe-4fb5473a615c admin admin] 10.222.0.82 "DELETE /v2.0/subnets/3ff6b3dc-d0ec-4376-9f06-6b97dedae0f7 HTTP/1.1" status: 204 len: 168 time: 0.2267056 Nov 18 18:25:36.759378 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 42290) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:36.831257 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.916264 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.936621 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b6a3f2aa-a0f5-4706-b055-920feb448410']}} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:36.946766 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f2c05c1e-fc3a-498a-a2ce-e857ead7ffa3') {'for_net_delete': True} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:36.947049 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f2c05c1e-fc3a-498a-a2ce-e857ead7ffa3') {} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:36.956300 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14253766'] for segment, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.969783 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.975450 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] Releasing vlan 1308 on physical network physnet1 to pool {{(pid=102688) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:25:36.975830 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-13993202'] for segment, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: Traceback (most recent call last): Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: timer() Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: cb(*args, **kw) Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: return func(*args, **kwargs) Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: self._notify() Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: self.callback(batched_events) Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: event.method(event) Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: return f(self, *a, **k) Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._get(url).json() Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: return self.request(url, 'GET', **kwargs) Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:25:36.977490 dv-cinder-787764-6-iscsi neutron-server[102688]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:25:37.035834 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.040890 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.044087 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] 10.222.0.82 "DELETE /v2.0/networks/b6a3f2aa-a0f5-4706-b055-920feb448410 HTTP/1.1" status: 204 len: 168 time: 0.2836223 Nov 18 18:25:37.047069 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42294) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:37.055292 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-086ca38b-19ae-4038-a4d7-a15dabb0ac23 admin admin] Pushing event deleted for resources: {'Network': ['ID=b6a3f2aa-a0f5-4706-b055-920feb448410,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:37.091170 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_v2 [None req-e99a3039-acd8-4f7a-b07f-c1ab5d9ecb46 admin admin] Deleting subnet 1c5bd7dc-b2c3-460e-b1d5-2e325e79b526 {{(pid=102689) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:25:37.094531 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e99a3039-acd8-4f7a-b07f-c1ab5d9ecb46 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.133528 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e99a3039-acd8-4f7a-b07f-c1ab5d9ecb46 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12724830'] for subnet, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.170645 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e99a3039-acd8-4f7a-b07f-c1ab5d9ecb46 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.220656 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e99a3039-acd8-4f7a-b07f-c1ab5d9ecb46 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12723963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14479099'] for subnet, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.246958 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e99a3039-acd8-4f7a-b07f-c1ab5d9ecb46 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1c5bd7dc-b2c3-460e-b1d5-2e325e79b526,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:37.248940 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e99a3039-acd8-4f7a-b07f-c1ab5d9ecb46 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.252250 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-e99a3039-acd8-4f7a-b07f-c1ab5d9ecb46 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/1c5bd7dc-b2c3-460e-b1d5-2e325e79b526 HTTP/1.1" status: 204 len: 168 time: 0.2039895 Nov 18 18:25:37.254789 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42296) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:37.324833 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.401472 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.421264 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b6befa18-580b-4d26-a7cb-c89ee66a86c4']}} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:37.430925 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '52d24af3-4f1e-40d4-8643-630614866152') {'for_net_delete': True} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:37.431219 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '52d24af3-4f1e-40d4-8643-630614866152') {} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:25:37.440320 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12724807'] for segment, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.453952 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.461287 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] Releasing vlan 1307 on physical network physnet1 to pool {{(pid=102689) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:25:37.461674 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12723877'] for segment, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: Traceback (most recent call last): Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: timer() Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: cb(*args, **kw) Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: return func(*args, **kwargs) Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: self._notify() Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: self.callback(batched_events) Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: event.method(event) Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: return f(self, *a, **k) Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._get(url).json() Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: return self.request(url, 'GET', **kwargs) Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:25:37.463471 dv-cinder-787764-6-iscsi neutron-server[102689]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:25:37.522118 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.527442 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.530652 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] 10.222.0.82 "DELETE /v2.0/networks/b6befa18-580b-4d26-a7cb-c89ee66a86c4 HTTP/1.1" status: 204 len: 168 time: 0.2750525 Nov 18 18:25:37.541310 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-348bbc17-a0a3-45bc-a6fe-52ab1f776d2f admin admin] Pushing event deleted for resources: {'Network': ['ID=b6befa18-580b-4d26-a7cb-c89ee66a86c4,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:37.683186 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42300) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:37.707280 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.722794 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-c32bfd9a-5070-4c66-bba6-c01e64d2ca9a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8502b10e2ed542cfa5c2b87f6e75c28e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0383854 Nov 18 18:25:37.725283 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42302) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:37.771446 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7b9658e1-860d-4b14-b8f6-57b8e4203037 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.792797 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7b9658e1-860d-4b14-b8f6-57b8e4203037 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.840206 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7b9658e1-860d-4b14-b8f6-57b8e4203037 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.843016 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7b9658e1-860d-4b14-b8f6-57b8e4203037 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:37.846544 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-7b9658e1-860d-4b14-b8f6-57b8e4203037 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c9bc305b-9d94-44c9-bbd3-80aecdf9db76 HTTP/1.1" status: 204 len: 168 time: 0.1179912 Nov 18 18:25:37.852177 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b9658e1-860d-4b14-b8f6-57b8e4203037 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9bc305b-9d94-44c9-bbd3-80aecdf9db76,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:38.150728 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42310) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:38.190267 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-a0aa8970-6d93-4393-928e-a482a609770f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5a6c9d8e5e7e44759fe9bb50421958ad&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0368619 Nov 18 18:25:38.191135 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42314) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:38.239710 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-df44338e-3d99-4442-add7-e31b26c6a283 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:38.261342 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-df44338e-3d99-4442-add7-e31b26c6a283 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:38.309650 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-df44338e-3d99-4442-add7-e31b26c6a283 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:38.312338 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-df44338e-3d99-4442-add7-e31b26c6a283 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:38.313511 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-df44338e-3d99-4442-add7-e31b26c6a283 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f4b350c7-195b-47e3-b6d6-6e29d692eb48 HTTP/1.1" status: 204 len: 168 time: 0.1214535 Nov 18 18:25:38.323408 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df44338e-3d99-4442-add7-e31b26c6a283 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4b350c7-195b-47e3-b6d6-6e29d692eb48,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:39.048317 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:39.930367 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 42378) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:40.029618 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9166ebd0-a5cc-417f-a1d2-0c309f152e62 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.102151 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9166ebd0-a5cc-417f-a1d2-0c309f152e62 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.105750 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9166ebd0-a5cc-417f-a1d2-0c309f152e62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.142078 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-9166ebd0-a5cc-417f-a1d2-0c309f152e62 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=50a2f0b07eb249bd8edcfc0489c16310&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2106552 Nov 18 18:25:40.142924 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9166ebd0-a5cc-417f-a1d2-0c309f152e62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ff78c20-7cb2-46ba-b313-2062df572622,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:40.145570 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42384) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:40.175681 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.197678 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e321e356-7032-4b5e-b0ab-a26ed66925c7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.219726 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e321e356-7032-4b5e-b0ab-a26ed66925c7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.269717 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e321e356-7032-4b5e-b0ab-a26ed66925c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.272328 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e321e356-7032-4b5e-b0ab-a26ed66925c7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.273985 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-e321e356-7032-4b5e-b0ab-a26ed66925c7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8ff78c20-7cb2-46ba-b313-2062df572622 HTTP/1.1" status: 204 len: 168 time: 0.1270278 Nov 18 18:25:40.281469 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e321e356-7032-4b5e-b0ab-a26ed66925c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ff78c20-7cb2-46ba-b313-2062df572622,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:40.529819 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42392) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:40.542554 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ce41cf9d-5add-44e2-b7de-5ef0e71e2abb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.613503 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ce41cf9d-5add-44e2-b7de-5ef0e71e2abb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.616773 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ce41cf9d-5add-44e2-b7de-5ef0e71e2abb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.654247 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-ce41cf9d-5add-44e2-b7de-5ef0e71e2abb admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=027373ade27a4da8b74dcaf6f609a25a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1233792 Nov 18 18:25:40.655348 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce41cf9d-5add-44e2-b7de-5ef0e71e2abb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57495fa2-e254-4847-8db1-e107c408e435,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:40.656991 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 42394) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:40.702874 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fc24bc90-e6f4-4028-a20c-3fdad257613b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.724002 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fc24bc90-e6f4-4028-a20c-3fdad257613b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.772335 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fc24bc90-e6f4-4028-a20c-3fdad257613b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.774934 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fc24bc90-e6f4-4028-a20c-3fdad257613b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:40.776120 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-fc24bc90-e6f4-4028-a20c-3fdad257613b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/57495fa2-e254-4847-8db1-e107c408e435 HTTP/1.1" status: 204 len: 168 time: 0.1181116 Nov 18 18:25:40.783748 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc24bc90-e6f4-4028-a20c-3fdad257613b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57495fa2-e254-4847-8db1-e107c408e435,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:41.479756 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:25:42.863286 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd6cad3-bd8a-4fee-9820-f5639718be52 req-8789403b-9df5-4dc0-b346-9deb00a4dd23 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:42.865319 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba34eee-c161-464c-81c2-56f974b8d564 req-56fdf674-f514-41e0-84fb-a5fd257829f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:42.868092 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2ba34eee-c161-464c-81c2-56f974b8d564 req-56fdf674-f514-41e0-84fb-a5fd257829f9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=46a1cb48de6e4f43a563f40fd92f0bf0&device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 1138 time: 0.0532465 Nov 18 18:25:42.868738 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-efd6cad3-bd8a-4fee-9820-f5639718be52 req-8789403b-9df5-4dc0-b346-9deb00a4dd23 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0639968 Nov 18 18:25:42.950815 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-efd6cad3-bd8a-4fee-9820-f5639718be52 req-3335b276-81ac-4468-8b6c-03d795da6f65 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0776577 Nov 18 18:25:42.983610 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba34eee-c161-464c-81c2-56f974b8d564 req-f28f5402-bd32-4b2b-90bb-7d0f885c8835 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:42.985124 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2ba34eee-c161-464c-81c2-56f974b8d564 req-f28f5402-bd32-4b2b-90bb-7d0f885c8835 service neutron] 10.222.0.31 "GET /v2.0/networks?id=c5332eb5-c186-4bcf-89d9-eb78be973548 HTTP/1.1" status: 200 len: 917 time: 0.1037755 Nov 18 18:25:43.065778 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2ba34eee-c161-464c-81c2-56f974b8d564 req-233ebdcd-8255-46c9-ae7b-97c13ece9316 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80 HTTP/1.1" status: 200 len: 1002 time: 0.0595224 Nov 18 18:25:43.126371 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba34eee-c161-464c-81c2-56f974b8d564 req-7643bcbc-5f7c-442c-96b7-008fc0b55ca3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:43.127734 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2ba34eee-c161-464c-81c2-56f974b8d564 req-7643bcbc-5f7c-442c-96b7-008fc0b55ca3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24097eeb-7eeb-4617-b83d-a363de5de9b1 HTTP/1.1" status: 200 len: 854 time: 0.0423629 Nov 18 18:25:43.180360 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba34eee-c161-464c-81c2-56f974b8d564 req-c72940b6-54d5-49d0-acd4-202f3698dfc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:43.181878 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2ba34eee-c161-464c-81c2-56f974b8d564 req-c72940b6-54d5-49d0-acd4-202f3698dfc9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c5332eb5-c186-4bcf-89d9-eb78be973548&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0391650 Nov 18 18:25:43.285161 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2ba34eee-c161-464c-81c2-56f974b8d564 req-96977b8e-0378-426a-852c-94696d96716c service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0883579 Nov 18 18:25:43.384245 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2ba34eee-c161-464c-81c2-56f974b8d564 req-b5667fdf-4eda-4d2e-8f04-a2920c86289d service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853360 Nov 18 18:25:44.075687 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-922800d8-fa18-4b1b-b613-6310cff87ac5 req-d1eac119-0f3e-4553-b5e0-4781c4b27d6b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:44.076332 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-922800d8-fa18-4b1b-b613-6310cff87ac5 req-d1eac119-0f3e-4553-b5e0-4781c4b27d6b tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0546815 Nov 18 18:25:44.137908 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-922800d8-fa18-4b1b-b613-6310cff87ac5 req-69dcd2ec-e98b-4d78-a6bf-bc562249b431 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0552685 Nov 18 18:25:45.252534 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc7ac784-7689-4cf4-9af1-dd750d583837 req-0c6c5385-322f-46af-8a0b-bfbbdbac4aae tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:45.254034 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc7ac784-7689-4cf4-9af1-dd750d583837 req-0c6c5385-322f-46af-8a0b-bfbbdbac4aae tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0489223 Nov 18 18:25:45.313431 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc7ac784-7689-4cf4-9af1-dd750d583837 req-399ebcb2-f4eb-4cdc-bda1-b6fc2b865d2f tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0526800 Nov 18 18:25:45.641808 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 42528) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:45.744253 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-40e88900-ed47-4a10-84f0-5d1437b24382 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:45.815257 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-40e88900-ed47-4a10-84f0-5d1437b24382 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:45.818972 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-40e88900-ed47-4a10-84f0-5d1437b24382 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:45.856793 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-40e88900-ed47-4a10-84f0-5d1437b24382 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=94d3e96a727d42d48f17a9a10b96221e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2139075 Nov 18 18:25:45.859298 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40e88900-ed47-4a10-84f0-5d1437b24382 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38f769ce-7a44-4cad-bc38-c95177ff2211,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:45.859658 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42534) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:45.906987 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c4efb710-b76d-4153-980c-774d046ddaa7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:45.931329 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c4efb710-b76d-4153-980c-774d046ddaa7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:45.976080 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c4efb710-b76d-4153-980c-774d046ddaa7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:45.979091 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c4efb710-b76d-4153-980c-774d046ddaa7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:45.980285 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-c4efb710-b76d-4153-980c-774d046ddaa7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/38f769ce-7a44-4cad-bc38-c95177ff2211 HTTP/1.1" status: 204 len: 168 time: 0.1183903 Nov 18 18:25:45.987628 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4efb710-b76d-4153-980c-774d046ddaa7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38f769ce-7a44-4cad-bc38-c95177ff2211,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:46.228754 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 42540) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:46.241701 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1cf7f153-cf14-4736-ab18-0334be89c7ee admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:46.313059 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1cf7f153-cf14-4736-ab18-0334be89c7ee admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:46.316744 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1cf7f153-cf14-4736-ab18-0334be89c7ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:46.354284 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-1cf7f153-cf14-4736-ab18-0334be89c7ee admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=eaeafdc190ad44aeae3b0b50011137b7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1245027 Nov 18 18:25:46.356237 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf7f153-cf14-4736-ab18-0334be89c7ee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a341a3a9-ea23-41e8-bd19-773472777170,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:46.356946 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42544) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:46.432015 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0405acdd-8603-4e3e-9f02-c0c23dd41fa9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:46.462065 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36b14991-eb88-4acf-ac0e-9faa6ca00538 req-9e70519a-82ec-40d8-8221-d03cd58e41e9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:46.463550 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-36b14991-eb88-4acf-ac0e-9faa6ca00538 req-9e70519a-82ec-40d8-8221-d03cd58e41e9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0776410 Nov 18 18:25:46.468295 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0405acdd-8603-4e3e-9f02-c0c23dd41fa9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:46.551553 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-36b14991-eb88-4acf-ac0e-9faa6ca00538 req-44fc1993-5576-404f-a4d0-3aa8c17a6229 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0812879 Nov 18 18:25:46.558844 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0405acdd-8603-4e3e-9f02-c0c23dd41fa9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:46.561468 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0405acdd-8603-4e3e-9f02-c0c23dd41fa9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:46.562538 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-0405acdd-8603-4e3e-9f02-c0c23dd41fa9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a341a3a9-ea23-41e8-bd19-773472777170 HTTP/1.1" status: 204 len: 168 time: 0.2046242 Nov 18 18:25:46.571430 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0405acdd-8603-4e3e-9f02-c0c23dd41fa9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a341a3a9-ea23-41e8-bd19-773472777170,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:46.873713 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42554) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:46.887498 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3443294b-2aa1-499e-a5e1-52ebfaed89f3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:46.959506 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3443294b-2aa1-499e-a5e1-52ebfaed89f3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:46.964299 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3443294b-2aa1-499e-a5e1-52ebfaed89f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:47.002260 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-3443294b-2aa1-499e-a5e1-52ebfaed89f3 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=503041ffaaa24b499bdd3087d78b5881&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1274989 Nov 18 18:25:47.003371 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3443294b-2aa1-499e-a5e1-52ebfaed89f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1feb8677-43fd-4723-a52a-6388b7187915,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:47.005015 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 42556) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:25:47.058220 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d3f329a5-240e-49fc-bc46-467af4168472 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:47.078633 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d3f329a5-240e-49fc-bc46-467af4168472 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:47.124384 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d3f329a5-240e-49fc-bc46-467af4168472 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:47.126962 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d3f329a5-240e-49fc-bc46-467af4168472 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:47.128177 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-d3f329a5-240e-49fc-bc46-467af4168472 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1feb8677-43fd-4723-a52a-6388b7187915 HTTP/1.1" status: 204 len: 168 time: 0.1221042 Nov 18 18:25:47.136375 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f329a5-240e-49fc-bc46-467af4168472 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1feb8677-43fd-4723-a52a-6388b7187915,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:25:47.670295 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b3ac918-ce68-4d9b-a23a-f15f43654139 req-58f6b585-b6a8-420d-9df8-40616782888c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:47.671838 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9b3ac918-ce68-4d9b-a23a-f15f43654139 req-58f6b585-b6a8-420d-9df8-40616782888c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0514421 Nov 18 18:25:47.732720 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9b3ac918-ce68-4d9b-a23a-f15f43654139 req-15bc32d8-4c04-459a-b646-9b0cd345821e tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0549550 Nov 18 18:25:48.848867 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5cf6f74-f4be-4cea-a83e-bdad2b1684e0 req-fc63c9d3-df02-46e7-8079-aaa72904c98a tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:48.850339 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f5cf6f74-f4be-4cea-a83e-bdad2b1684e0 req-fc63c9d3-df02-46e7-8079-aaa72904c98a tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0505462 Nov 18 18:25:48.908091 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f5cf6f74-f4be-4cea-a83e-bdad2b1684e0 req-b04909e1-b801-4212-9a29-5d417f6f258c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0510445 Nov 18 18:25:49.361934 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146392e6-8177-4f83-b313-9827f558087f req-44c56989-3f6b-43af-942b-f11bbd8062a5 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:49.363435 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-146392e6-8177-4f83-b313-9827f558087f req-44c56989-3f6b-43af-942b-f11bbd8062a5 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0508828 Nov 18 18:25:49.412078 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-146392e6-8177-4f83-b313-9827f558087f req-21f47d82-6aae-4d39-8ead-6f5721bfa758 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414927 Nov 18 18:25:50.019046 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90c00e31-9401-4355-a253-81cacf3e4a4b req-13150d2b-6b72-40c9-997c-ccd5c4704093 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:50.020428 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-90c00e31-9401-4355-a253-81cacf3e4a4b req-13150d2b-6b72-40c9-997c-ccd5c4704093 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0469334 Nov 18 18:25:50.082007 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-90c00e31-9401-4355-a253-81cacf3e4a4b req-8fa302dc-8294-40b0-9a72-da820ee4164c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0550430 Nov 18 18:25:50.525688 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d1b29a-5029-48e2-b61e-9baa9d2fac1f req-d7d43426-88e1-499f-8eb5-2b13dbb7a80e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:50.527175 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-95d1b29a-5029-48e2-b61e-9baa9d2fac1f req-d7d43426-88e1-499f-8eb5-2b13dbb7a80e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0475388 Nov 18 18:25:50.572475 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-95d1b29a-5029-48e2-b61e-9baa9d2fac1f req-78740dbd-c114-475e-92d8-98ed12bee48f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395193 Nov 18 18:25:51.126254 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:25:51.195427 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65c3f2a2-ec0e-4fec-afbd-0112a27d4406 req-d6b12aab-35b0-4f2f-92e3-eb3e3d2b784c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:51.196914 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65c3f2a2-ec0e-4fec-afbd-0112a27d4406 req-d6b12aab-35b0-4f2f-92e3-eb3e3d2b784c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0489001 Nov 18 18:25:51.254334 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65c3f2a2-ec0e-4fec-afbd-0112a27d4406 req-31a26f93-b786-452c-b532-782276573ab4 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0514688 Nov 18 18:25:51.685996 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd72cb1-eb0d-4be3-9b93-c866847cf0d6 req-884e9b6e-6b31-4638-9638-372693ad82be tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:51.687353 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fdd72cb1-eb0d-4be3-9b93-c866847cf0d6 req-884e9b6e-6b31-4638-9638-372693ad82be tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0501363 Nov 18 18:25:51.733535 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fdd72cb1-eb0d-4be3-9b93-c866847cf0d6 req-bcfa4ca5-1686-4fa9-b8a8-bc5ff3e2eb96 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403821 Nov 18 18:25:52.366098 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a7de38-582b-40c4-87f4-6afc99d2f0d5 req-81dfce4c-4afd-430c-bd5b-e3be4f4f78c4 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:52.368142 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a6a7de38-582b-40c4-87f4-6afc99d2f0d5 req-81dfce4c-4afd-430c-bd5b-e3be4f4f78c4 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0480452 Nov 18 18:25:52.426047 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a6a7de38-582b-40c4-87f4-6afc99d2f0d5 req-634e2b92-9ad8-46dc-be95-68f152b69404 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0520189 Nov 18 18:25:52.848597 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e98d03-f648-4810-a8e7-be2ffd315125 req-4d80f9c0-af8e-4489-aa7e-8b44fbd4ff65 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:52.850102 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-48e98d03-f648-4810-a8e7-be2ffd315125 req-4d80f9c0-af8e-4489-aa7e-8b44fbd4ff65 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0520716 Nov 18 18:25:52.896038 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-48e98d03-f648-4810-a8e7-be2ffd315125 req-f47dc49a-cbeb-4c34-b814-a5db9f049c83 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395486 Nov 18 18:25:53.540838 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35c34c6f-3605-4139-b4ba-4be0f9c5f326 req-81827d5e-10af-4e37-880b-d1857449ff6c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:53.542284 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-35c34c6f-3605-4139-b4ba-4be0f9c5f326 req-81827d5e-10af-4e37-880b-d1857449ff6c tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0468264 Nov 18 18:25:53.600910 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-35c34c6f-3605-4139-b4ba-4be0f9c5f326 req-16a915f6-d245-4e4d-8548-41eb25cee320 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0524065 Nov 18 18:25:54.011259 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-953235dd-9540-4c72-9b12-2aede77a43b8 req-32f94893-757c-40eb-ac47-f4a8d3c2fac6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:54.012761 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-953235dd-9540-4c72-9b12-2aede77a43b8 req-32f94893-757c-40eb-ac47-f4a8d3c2fac6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0483596 Nov 18 18:25:54.061199 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-953235dd-9540-4c72-9b12-2aede77a43b8 req-3840ac78-e1eb-4ad5-9b50-cf95be53f78c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425916 Nov 18 18:25:54.713226 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea0cd42-0d27-4aea-ac52-66e4ac44b1ac req-be2465f1-102c-428f-a421-c6028c41d1f7 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:54.714674 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7ea0cd42-0d27-4aea-ac52-66e4ac44b1ac req-be2465f1-102c-428f-a421-c6028c41d1f7 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0475764 Nov 18 18:25:54.773112 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7ea0cd42-0d27-4aea-ac52-66e4ac44b1ac req-67c29ef9-3319-4fba-9edb-8b1911e7a90d tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0522127 Nov 18 18:25:55.172142 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92bfd347-422f-4c90-8833-01364bb5a92a req-922df225-5bea-4b52-bc3c-f52bf2984c17 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:55.173605 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-92bfd347-422f-4c90-8833-01364bb5a92a req-922df225-5bea-4b52-bc3c-f52bf2984c17 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0475490 Nov 18 18:25:55.219226 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-92bfd347-422f-4c90-8833-01364bb5a92a req-7cad43e8-a897-4b7e-821f-81287a232df1 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398088 Nov 18 18:25:55.887708 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96cbee2f-a63d-4dc7-9704-73324f1c0631 req-fa517a28-e503-40c2-8f7b-b849065e5651 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:55.889089 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-96cbee2f-a63d-4dc7-9704-73324f1c0631 req-fa517a28-e503-40c2-8f7b-b849065e5651 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0503159 Nov 18 18:25:55.946611 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-96cbee2f-a63d-4dc7-9704-73324f1c0631 req-9e89651a-a60b-4cdc-8e73-f5c067adcd65 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0515878 Nov 18 18:25:56.330171 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7383d20c-df96-4907-a315-df98d983b7e8 req-3a1a0ada-3537-4cc3-ab49-bf3e4d058cd8 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:56.335913 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7383d20c-df96-4907-a315-df98d983b7e8 req-3a1a0ada-3537-4cc3-ab49-bf3e4d058cd8 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0514116 Nov 18 18:25:56.381302 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7383d20c-df96-4907-a315-df98d983b7e8 req-252acccc-26cd-4226-991f-e07d89c05cee tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382130 Nov 18 18:25:57.062112 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc92d0b-1158-4920-b6e7-0bf66a8e7fdb req-0eaf8ade-7d6f-4d83-aa33-7362ec2681ae tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:57.063762 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dcc92d0b-1158-4920-b6e7-0bf66a8e7fdb req-0eaf8ade-7d6f-4d83-aa33-7362ec2681ae tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0506775 Nov 18 18:25:57.129922 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dcc92d0b-1158-4920-b6e7-0bf66a8e7fdb req-9c81fd62-a535-49cc-ad92-85b3061b9867 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0596218 Nov 18 18:25:57.495354 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72d16ebd-912c-4ba3-9a03-7df35443163a req-23ff92a7-fcb2-4ba8-95b3-f31f08de1cc6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:57.496862 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-72d16ebd-912c-4ba3-9a03-7df35443163a req-23ff92a7-fcb2-4ba8-95b3-f31f08de1cc6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0483687 Nov 18 18:25:57.544415 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-72d16ebd-912c-4ba3-9a03-7df35443163a req-050b8beb-a36f-4c85-b429-56d09fdcbc83 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408838 Nov 18 18:25:58.240561 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e25c6f-991f-4e4d-84d2-41612c6bdcee req-bb1b909f-980f-428e-96b9-dcc714529b46 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:58.242783 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e9e25c6f-991f-4e4d-84d2-41612c6bdcee req-bb1b909f-980f-428e-96b9-dcc714529b46 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0483613 Nov 18 18:25:58.303937 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e9e25c6f-991f-4e4d-84d2-41612c6bdcee req-7a27be23-03ae-47fb-8a0d-514d724be5de tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0519710 Nov 18 18:25:58.658082 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66340382-a982-4eb5-945a-e1a22d38ec34 req-53d2bf3b-627d-4ac6-a8fc-173b1383bbfe tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:58.659880 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-66340382-a982-4eb5-945a-e1a22d38ec34 req-53d2bf3b-627d-4ac6-a8fc-173b1383bbfe tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0501680 Nov 18 18:25:58.705563 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-66340382-a982-4eb5-945a-e1a22d38ec34 req-b9007a4a-5293-46b0-9513-df19439058f4 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401025 Nov 18 18:25:59.420431 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8acdfab7-7caf-4ca1-80a0-907c9c0e0793 req-8d330e8c-c672-4727-8a86-3196811cf830 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:59.421937 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8acdfab7-7caf-4ca1-80a0-907c9c0e0793 req-8d330e8c-c672-4727-8a86-3196811cf830 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0507073 Nov 18 18:25:59.485728 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8acdfab7-7caf-4ca1-80a0-907c9c0e0793 req-f8333958-c4e3-41ff-b0b5-8b2f8930afd9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0575292 Nov 18 18:25:59.823172 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1665c1e5-f310-49a7-8d42-4ec3c4bb5bfc req-b6da8112-eaca-453b-be4a-f662d763f534 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:25:59.825208 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1665c1e5-f310-49a7-8d42-4ec3c4bb5bfc req-b6da8112-eaca-453b-be4a-f662d763f534 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0529113 Nov 18 18:25:59.872636 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1665c1e5-f310-49a7-8d42-4ec3c4bb5bfc req-943d8046-7401-48d8-92a4-d6ccea865985 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407457 Nov 18 18:26:00.534190 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42746) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:26:00.601356 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa0c1fb-9b88-4651-9fca-193707cd5825 req-4c7df27d-5ca4-4385-af45-6561e42ce695 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:00.603988 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1aa0c1fb-9b88-4651-9fca-193707cd5825 req-4c7df27d-5ca4-4385-af45-6561e42ce695 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0494978 Nov 18 18:26:00.645242 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-249a0252-a2f1-4139-b3ac-10b7e3503ed0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:00.692256 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1aa0c1fb-9b88-4651-9fca-193707cd5825 req-68be317a-70ff-4218-bdcd-35b3259f3a6e tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0820248 Nov 18 18:26:00.741300 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-249a0252-a2f1-4139-b3ac-10b7e3503ed0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:00.745171 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-249a0252-a2f1-4139-b3ac-10b7e3503ed0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:00.783091 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-249a0252-a2f1-4139-b3ac-10b7e3503ed0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2ba07b9-ebd1-4ca9-b78a-44b5ff313e77,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:00.787030 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-249a0252-a2f1-4139-b3ac-10b7e3503ed0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c3e3a17da1774b36898fee1f13d6457c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2517667 Nov 18 18:26:00.789671 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 42750) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:26:00.835171 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-17d63f93-cdf1-4078-868e-3771d119a8ec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:00.855780 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-17d63f93-cdf1-4078-868e-3771d119a8ec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:00.901167 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-17d63f93-cdf1-4078-868e-3771d119a8ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:00.903292 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-17d63f93-cdf1-4078-868e-3771d119a8ec admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:00.904441 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-17d63f93-cdf1-4078-868e-3771d119a8ec admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e2ba07b9-ebd1-4ca9-b78a-44b5ff313e77 HTTP/1.1" status: 204 len: 168 time: 0.1138883 Nov 18 18:26:00.912654 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d63f93-cdf1-4078-868e-3771d119a8ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2ba07b9-ebd1-4ca9-b78a-44b5ff313e77,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:00.993103 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4244adf-ed96-4708-a876-56438dc54ae6 req-a0040dfc-419a-45ea-899e-14af6e4240a1 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:00.994921 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a4244adf-ed96-4708-a876-56438dc54ae6 req-a0040dfc-419a-45ea-899e-14af6e4240a1 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0496995 Nov 18 18:26:01.044870 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a4244adf-ed96-4708-a876-56438dc54ae6 req-bcece54d-58e3-4757-a3c6-49e5e527a373 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439234 Nov 18 18:26:01.812706 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61be6dcd-913b-46bc-8ec0-5fe21d6ab5ce req-388be3aa-e44a-4721-b699-d2f1701dd230 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:01.814189 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-61be6dcd-913b-46bc-8ec0-5fe21d6ab5ce req-388be3aa-e44a-4721-b699-d2f1701dd230 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0548506 Nov 18 18:26:01.875618 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-61be6dcd-913b-46bc-8ec0-5fe21d6ab5ce req-f8cd0b72-4e3d-4425-9f5c-b883b42271da tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0551293 Nov 18 18:26:02.158098 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17d2ad64-11b6-49ee-b720-8d5d88375c4e req-403b5434-6497-4532-8ac2-66e6134b388a tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:02.159550 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-17d2ad64-11b6-49ee-b720-8d5d88375c4e req-403b5434-6497-4532-8ac2-66e6134b388a tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0474195 Nov 18 18:26:02.204231 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-17d2ad64-11b6-49ee-b720-8d5d88375c4e req-656c3813-c2b0-4cf5-b5cd-7f125d51f479 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388122 Nov 18 18:26:02.989794 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96c0091-c1f9-419f-b2a5-3b61b0e09b94 req-e17ca044-edb6-4eed-9767-a8be259e78d1 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:02.991516 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f96c0091-c1f9-419f-b2a5-3b61b0e09b94 req-e17ca044-edb6-4eed-9767-a8be259e78d1 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0493975 Nov 18 18:26:03.055414 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f96c0091-c1f9-419f-b2a5-3b61b0e09b94 req-5e6b8e93-8d57-4a5b-bee3-4f41e432d8b0 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0573184 Nov 18 18:26:03.086316 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-7c4c0ca1-7b56-4f02-aa92-86715fecb215 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=45bd08fb8c564fcf9a270b30944c6a8f&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0283797 Nov 18 18:26:03.277595 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-60a2a647-4fb1-435f-91d0-f89c722dfbb1 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:03.279048 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-60a2a647-4fb1-435f-91d0-f89c722dfbb1 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1868703 Nov 18 18:26:03.312536 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-76fdd500-6a62-468a-a6d2-2e2cfb5c76c7 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/quotas/45bd08fb8c564fcf9a270b30944c6a8f HTTP/1.1" status: 200 len: 375 time: 0.0246305 Nov 18 18:26:03.344009 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cedee994-7831-4878-afc3-7669e1ae76f9 req-d9f48cec-14e3-49ab-90a7-9aed046dbfda tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:03.345477 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-cedee994-7831-4878-afc3-7669e1ae76f9 req-d9f48cec-14e3-49ab-90a7-9aed046dbfda tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0655642 Nov 18 18:26:03.360869 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-f2e10c76-c556-43ec-8c10-dca3fdbc0737 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=45bd08fb8c564fcf9a270b30944c6a8f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0408969 Nov 18 18:26:03.401666 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-cedee994-7831-4878-afc3-7669e1ae76f9 req-b5434bfb-8088-4f38-93aa-9a77edd51861 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435572 Nov 18 18:26:03.515892 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3bc60746-4e88-4a91-9371-58dd48c5afe1 req-23cca31e-3c91-4847-bf45-586e228bd047 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 210 time: 0.0263920 Nov 18 18:26:03.911956 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd59051-d87e-4136-b31a-1becc9c3d671 req-8e2d27dd-2dde-4e80-a067-ac63f7e289bc tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:03.913500 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5bd59051-d87e-4136-b31a-1becc9c3d671 req-8e2d27dd-2dde-4e80-a067-ac63f7e289bc tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 946 time: 0.0476959 Nov 18 18:26:03.962027 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5bd59051-d87e-4136-b31a-1becc9c3d671 req-2b263e2b-5cb8-4f48-a066-082039b5ce94 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407910 Nov 18 18:26:03.988889 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1e1b8c49-27c6-4f8f-82fb-0dc52980e30e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:04.170713 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-addd4082-ab0c-4d40-9b42-d8d07bb69d00 req-5c0e26d5-4383-4436-8248-96046bb6e829 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:04.172191 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-addd4082-ab0c-4d40-9b42-d8d07bb69d00 req-5c0e26d5-4383-4436-8248-96046bb6e829 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0496638 Nov 18 18:26:04.230042 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-addd4082-ab0c-4d40-9b42-d8d07bb69d00 req-6eaae61c-445b-4003-9922-e95da7e6ea35 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0518463 Nov 18 18:26:04.512637 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-e76a1a54-423e-46d2-84ac-a1d1093c1815 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=45bd08fb8c564fcf9a270b30944c6a8f&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0281713 Nov 18 18:26:04.515642 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eece244f-da8b-43cb-a3a0-72d1e2b24e72 req-201e11d5-d4cc-44f0-a611-5d5413f12098 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:04.517224 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eece244f-da8b-43cb-a3a0-72d1e2b24e72 req-201e11d5-d4cc-44f0-a611-5d5413f12098 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0497518 Nov 18 18:26:04.572851 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eece244f-da8b-43cb-a3a0-72d1e2b24e72 req-99ea63f9-b013-4f39-b970-fbe57097e6fe tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480144 Nov 18 18:26:04.624781 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c8ceb6f9-24bd-4127-a393-fac620c8bf1f req-ff1c3fe8-b5e9-4c14-9fe6-3063cd286245 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 210 time: 0.0316019 Nov 18 18:26:04.725265 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-f9fec874-ec34-479d-b03a-0c04017b3f84 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:04.726685 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-f9fec874-ec34-479d-b03a-0c04017b3f84 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2047648 Nov 18 18:26:04.742486 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Request body: {'port': {'device_id': 'e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0', 'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c', 'admin_state_up': True, 'tenant_id': '45bd08fb8c564fcf9a270b30944c6a8f'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:26:05.036806 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Made reservation on behalf of 45bd08fb8c564fcf9a270b30944c6a8f for: {'port': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:26:05.040434 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:05.049194 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:05.081367 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a05a33be-50ed-4ee9-aa49-72adc438087a req-48902bc8-ccc7-42ec-817b-82ed4b72e8a6 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:05.083031 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a05a33be-50ed-4ee9-aa49-72adc438087a req-48902bc8-ccc7-42ec-817b-82ed4b72e8a6 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 946 time: 0.0487990 Nov 18 18:26:05.127283 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:05.130746 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a05a33be-50ed-4ee9-aa49-72adc438087a req-975d725a-cbbc-4025-a189-5784a0318680 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414386 Nov 18 18:26:05.131336 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:05.212413 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:05.265002 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Allocated IP 192.168.233.214 (91915bce-58a8-4d07-8162-223eca50fa5c/5272349c-eb4d-440c-8d7e-450aec9b1220/180b4da0-eec7-4cb2-9366-c5b7bf587c5d) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:26:05.343247 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dac7cbf-d65d-4b8d-a373-c4314075b1c2 req-d7dababe-1abe-45d1-8a50-85ed8396f943 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:05.344786 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0dac7cbf-d65d-4b8d-a373-c4314075b1c2 req-d7dababe-1abe-45d1-8a50-85ed8396f943 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0491471 Nov 18 18:26:05.404065 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0dac7cbf-d65d-4b8d-a373-c4314075b1c2 req-6fe464e5-1dc7-4aa2-ad3d-b48782c1e4cf tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=43932994-97a2-4b28-a8c8-cacaf8d0e5e6&id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0532832 Nov 18 18:26:05.414470 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:05.448319 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:05.488771 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Network 91915bce-58a8-4d07-8162-223eca50fa5c is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:26:05.491740 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:26:05.494749 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:26:05.525977 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Pushing event updated for resources: {'Port': ['ID=180b4da0-eec7-4cb2-9366-c5b7bf587c5d,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:05.552812 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:05.553550 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:05.570762 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-047e9f11-a632-4ff9-831d-41ad2edf228c tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.8316996 Nov 18 18:26:05.585718 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Request body: {'port': {'device_id': 'e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:26:05.648679 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:05.673533 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-4b3e6d47-ffa6-4dc8-8fb4-9dfd98275eda None None] Provisioning complete for port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:26:05.674066 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-4b3e6d47-ffa6-4dc8-8fb4-9dfd98275eda None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:05.703011 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2df9fb8a-0021-42a7-9727-e8781f3b4c79 req-5e1ea963-c17c-4874-8904-23c6bc6737d3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:05.704387 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2df9fb8a-0021-42a7-9727-e8781f3b4c79 req-5e1ea963-c17c-4874-8904-23c6bc6737d3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0611944 Nov 18 18:26:05.719472 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-4b3e6d47-ffa6-4dc8-8fb4-9dfd98275eda None None] Port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:26:05.769473 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ada190-fc98-401a-9133-d1f7abcd6249 req-c1431041-d737-4d8c-87d3-fbbb0947875a tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:05.770980 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-37ada190-fc98-401a-9133-d1f7abcd6249 req-c1431041-d737-4d8c-87d3-fbbb0947875a tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 936 time: 0.0652008 Nov 18 18:26:05.806664 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2df9fb8a-0021-42a7-9727-e8781f3b4c79 req-bea9df34-4a22-438b-bcf4-c6b824df2a80 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0918951 Nov 18 18:26:05.834448 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-37ada190-fc98-401a-9133-d1f7abcd6249 req-25337457-c541-49e0-8bab-9f58b19f564e tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552731 Nov 18 18:26:05.918002 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 180b4da0-eec7-4cb2-9366-c5b7bf587c5d {{(pid=102688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:26:05.925317 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:05.937508 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.provisioning_blocks [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Transition to ACTIVE for port object 180b4da0-eec7-4cb2-9366-c5b7bf587c5d will not be triggered until provisioned by entity L2. {{(pid=102688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:26:05.941375 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-13993110'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:06.008683 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Pushing event updated for resources: {'Port': ['ID=180b4da0-eec7-4cb2-9366-c5b7bf587c5d,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:06.062022 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Attempting to bind port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:26:06.062366 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Attempting to bind port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': 'b61c9483-d3e6-44f4-9b6d-859c2fd0b703', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c'}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:26:06.062703 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Attempting to bind port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d on network 91915bce-58a8-4d07-8162-223eca50fa5c {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:26:06.067217 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d on network 91915bce-58a8-4d07-8162-223eca50fa5c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:26:06.067539 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Attempting to bind port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d on network 91915bce-58a8-4d07-8162-223eca50fa5c {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:26:06.072541 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 25, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:26:06.072883 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Checking segment: {'id': 'b61c9483-d3e6-44f4-9b6d-859c2fd0b703', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:26:06.073276 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Bound using segment: {'id': 'b61c9483-d3e6-44f4-9b6d-859c2fd0b703', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c'} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:26:06.073705 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Bound port: 180b4da0-eec7-4cb2-9366-c5b7bf587c5d, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b61c9483-d3e6-44f4-9b6d-859c2fd0b703', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c'}}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:26:06.074065 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:06.141170 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] For port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d, host hv-cinder-78776, cleared binding levels {{(pid=102688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:26:06.145570 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] For port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=180b4da0-eec7-4cb2-9366-c5b7bf587c5d,segment=NetworkSegment(b61c9483-d3e6-44f4-9b6d-859c2fd0b703),segment_id=b61c9483-d3e6-44f4-9b6d-859c2fd0b703)] {{(pid=102688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:26:06.149820 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-13993110'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:06.186923 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:06.187552 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:06.188999 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] 10.222.0.31 "PUT /v2.0/ports/180b4da0-eec7-4cb2-9366-c5b7bf587c5d HTTP/1.1" status: 200 len: 1098 time: 0.6076181 Nov 18 18:26:06.189445 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0', 'tag': '180b4da0-eec7-4cb2-9366-c5b7bf587c5d'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:26:06.191694 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ecf41108-7cad-4409-abe8-0bae062924ad" -d '{"events": [{"name": "network-changed", "server_uuid": "e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0", "tag": "180b4da0-eec7-4cb2-9366-c5b7bf587c5d"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:26:06.220187 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af40fe42-c629-486d-abee-e2fc143a868e service neutron] Pushing event updated for resources: {'Port': ['ID=180b4da0-eec7-4cb2-9366-c5b7bf587c5d,revision_number=3']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:06.252221 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:26:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-855a1e7f-348d-472f-b1d3-5ada4f1e207d x-openstack-request-id: req-855a1e7f-348d-472f-b1d3-5ada4f1e207d {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:26:06.252513 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0", "tag": "180b4da0-eec7-4cb2-9366-c5b7bf587c5d", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:26:06.252777 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-855a1e7f-348d-472f-b1d3-5ada4f1e207d {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:26:06.253187 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0', 'tag': '180b4da0-eec7-4cb2-9366-c5b7bf587c5d', 'status': 'completed', 'code': 200} Nov 18 18:26:06.291570 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c71ab63-e1e3-4ffb-a570-d548abdd9aab req-c64172e5-5932-40c6-b549-079d34c007e4 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:06.299103 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8c71ab63-e1e3-4ffb-a570-d548abdd9aab req-c64172e5-5932-40c6-b549-079d34c007e4 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 946 time: 0.0602307 Nov 18 18:26:06.302928 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-a96b4068-7ab7-4662-be78-f62b873cb1e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:06.304561 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-a96b4068-7ab7-4662-be78-f62b873cb1e6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=45bd08fb8c564fcf9a270b30944c6a8f&device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 1101 time: 0.0505519 Nov 18 18:26:06.346489 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8c71ab63-e1e3-4ffb-a570-d548abdd9aab req-cb6db7bb-8269-4c90-9740-02cb893eccee tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463736 Nov 18 18:26:06.357058 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-7edbc825-1151-4e83-9682-7ff86ed2f2c6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.214&port_id=180b4da0-eec7-4cb2-9366-c5b7bf587c5d HTTP/1.1" status: 200 len: 217 time: 0.0374010 Nov 18 18:26:06.419822 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-3aaca738-3fcc-4952-8fdb-698ec818dbc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:06.421582 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-3aaca738-3fcc-4952-8fdb-698ec818dbc8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5272349c-eb4d-440c-8d7e-450aec9b1220 HTTP/1.1" status: 200 len: 843 time: 0.0450983 Nov 18 18:26:06.433825 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-cfc7d9ca-a364-4e79-891b-e4691bd645bb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:06.464535 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-134d4355-963e-4b4f-9f62-c63473a71f51 req-4c370ffe-a8b4-4c9b-81b5-0b19f2b8f0fe tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:06.466332 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-134d4355-963e-4b4f-9f62-c63473a71f51 req-4c370ffe-a8b4-4c9b-81b5-0b19f2b8f0fe tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.31 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 946 time: 0.0597761 Nov 18 18:26:06.478637 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-c7fc83a5-e303-45c3-ad76-a013ef15d596 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:06.480196 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-c7fc83a5-e303-45c3-ad76-a013ef15d596 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91915bce-58a8-4d07-8162-223eca50fa5c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0460072 Nov 18 18:26:06.559308 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-134d4355-963e-4b4f-9f62-c63473a71f51 req-e7a35cb2-ac1a-42fe-a046-9bbceb8867ac tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Deleting port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:26:06.559308 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-134d4355-963e-4b4f-9f62-c63473a71f51 req-e7a35cb2-ac1a-42fe-a046-9bbceb8867ac tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:06.579296 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-9b3ea8c0-d489-45b3-9010-e387dbb915bc service neutron] 10.222.0.31 "GET /v2.0/networks/91915bce-58a8-4d07-8162-223eca50fa5c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819631 Nov 18 18:26:06.647529 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-134d4355-963e-4b4f-9f62-c63473a71f51 req-e7a35cb2-ac1a-42fe-a046-9bbceb8867ac tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] For port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8,segment=NetworkSegment(6f13a496-1ac6-44ee-a618-9dee39276ca6),segment_id=6f13a496-1ac6-44ee-a618-9dee39276ca6)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:06.647876 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-134d4355-963e-4b4f-9f62-c63473a71f51 req-e7a35cb2-ac1a-42fe-a046-9bbceb8867ac tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:06.660646 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-134d4355-963e-4b4f-9f62-c63473a71f51 req-e7a35cb2-ac1a-42fe-a046-9bbceb8867ac tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Calling delete_port for f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:26:06.681116 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-5d469556-3e45-47d0-a5e4-bcfabd8f94ec req-a7267c4e-649e-4e26-ad2b-726913c21385 service neutron] 10.222.0.31 "GET /v2.0/networks/91915bce-58a8-4d07-8162-223eca50fa5c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0855131 Nov 18 18:26:06.785094 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecf41108-7cad-4409-abe8-0bae062924ad req-5f916c42-2884-456e-a089-3dead67976ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:06.786603 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ecf41108-7cad-4409-abe8-0bae062924ad req-5f916c42-2884-456e-a089-3dead67976ac service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=45bd08fb8c564fcf9a270b30944c6a8f&device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 1101 time: 0.0440598 Nov 18 18:26:06.897688 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecf41108-7cad-4409-abe8-0bae062924ad req-dc462852-acd9-451d-adbf-c974442f7035 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:06.899404 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ecf41108-7cad-4409-abe8-0bae062924ad req-dc462852-acd9-451d-adbf-c974442f7035 service neutron] 10.222.0.31 "GET /v2.0/networks?id=91915bce-58a8-4d07-8162-223eca50fa5c HTTP/1.1" status: 200 len: 871 time: 0.1043124 Nov 18 18:26:06.943240 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ecf41108-7cad-4409-abe8-0bae062924ad req-88d7b988-b829-471c-ae64-2aac6d60bbb5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.214&port_id=180b4da0-eec7-4cb2-9366-c5b7bf587c5d HTTP/1.1" status: 200 len: 217 time: 0.0348165 Nov 18 18:26:07.004405 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecf41108-7cad-4409-abe8-0bae062924ad req-5715983d-2116-4828-9577-3aaf259ee184 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:07.006093 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ecf41108-7cad-4409-abe8-0bae062924ad req-5715983d-2116-4828-9577-3aaf259ee184 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5272349c-eb4d-440c-8d7e-450aec9b1220 HTTP/1.1" status: 200 len: 843 time: 0.0466650 Nov 18 18:26:07.053979 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecf41108-7cad-4409-abe8-0bae062924ad req-5d38a171-8caa-417c-9fe9-6a84bb790ed8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:07.055499 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ecf41108-7cad-4409-abe8-0bae062924ad req-5d38a171-8caa-417c-9fe9-6a84bb790ed8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91915bce-58a8-4d07-8162-223eca50fa5c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0394988 Nov 18 18:26:07.073573 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-409c5f29-dead-4e26-beb7-bfde0ae836ea req-0f8187e1-1c30-4aff-b430-a6ba9e107228 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:07.075019 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-409c5f29-dead-4e26-beb7-bfde0ae836ea req-0f8187e1-1c30-4aff-b430-a6ba9e107228 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1167645 Nov 18 18:26:07.082097 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce1aca81-93b2-412e-b82b-b43833017829 req-82a97f79-6af7-46c6-9f61-bad3d5ff9fb4 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:07.083442 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ce1aca81-93b2-412e-b82b-b43833017829 req-82a97f79-6af7-46c6-9f61-bad3d5ff9fb4 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 948 time: 0.1262875 Nov 18 18:26:07.111880 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-134d4355-963e-4b4f-9f62-c63473a71f51 req-e7a35cb2-ac1a-42fe-a046-9bbceb8867ac tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:07.127334 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['f68b74ad-70ac-4b59-8ffa-4859b8aac5a8'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:26:07.156756 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ecf41108-7cad-4409-abe8-0bae062924ad req-add689c4-4aa1-47b4-9703-7b2abed37cf2 service neutron] 10.222.0.31 "GET /v2.0/networks/91915bce-58a8-4d07-8162-223eca50fa5c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0920739 Nov 18 18:26:07.161173 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7a35cb2-ac1a-42fe-a046-9bbceb8867ac tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Pushing event deleted for resources: {'Port': ['ID=f68b74ad-70ac-4b59-8ffa-4859b8aac5a8,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:07.206249 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-409c5f29-dead-4e26-beb7-bfde0ae836ea req-c08e9aaf-b13e-4606-a925-d67d810692fa tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1218197 Nov 18 18:26:07.225363 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ce1aca81-93b2-412e-b82b-b43833017829 req-4b4292ad-6ded-4541-9e52-ff31d412d95f tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1333308 Nov 18 18:26:07.226201 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-134d4355-963e-4b4f-9f62-c63473a71f51 req-e7a35cb2-ac1a-42fe-a046-9bbceb8867ac tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] No DVR routers for this DVR port f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:26:07.229103 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-134d4355-963e-4b4f-9f62-c63473a71f51 req-e7a35cb2-ac1a-42fe-a046-9bbceb8867ac tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:07.232491 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-134d4355-963e-4b4f-9f62-c63473a71f51 req-e7a35cb2-ac1a-42fe-a046-9bbceb8867ac tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.31 "DELETE /v2.0/ports/f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 HTTP/1.1" status: 204 len: 173 time: 0.7587063 Nov 18 18:26:07.232923 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f211d1a4-033e-4318-bffa-31f11b44bace', 'name': 'network-vif-deleted', 'tag': 'f68b74ad-70ac-4b59-8ffa-4859b8aac5a8'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:26:07.235257 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee1f1671-f8c4-40e2-80c3-d1b020e9c846" -d '{"events": [{"server_uuid": "f211d1a4-033e-4318-bffa-31f11b44bace", "name": "network-vif-deleted", "tag": "f68b74ad-70ac-4b59-8ffa-4859b8aac5a8"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:26:07.257846 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ecf41108-7cad-4409-abe8-0bae062924ad req-b73ab7a3-0110-444e-9071-8315d005402d service neutron] 10.222.0.31 "GET /v2.0/networks/91915bce-58a8-4d07-8162-223eca50fa5c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901427 Nov 18 18:26:07.289516 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:26:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e8a89aa6-7660-4713-9c8d-007547e41338 x-openstack-request-id: req-e8a89aa6-7660-4713-9c8d-007547e41338 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:26:07.289916 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f211d1a4-033e-4318-bffa-31f11b44bace", "name": "network-vif-deleted", "tag": "f68b74ad-70ac-4b59-8ffa-4859b8aac5a8", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:26:07.290174 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-e8a89aa6-7660-4713-9c8d-007547e41338 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:26:07.290588 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f211d1a4-033e-4318-bffa-31f11b44bace', 'name': 'network-vif-deleted', 'tag': 'f68b74ad-70ac-4b59-8ffa-4859b8aac5a8', 'status': 'completed', 'code': 200} Nov 18 18:26:07.449068 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f7fce3f2-09ed-48ea-8060-5867b14f4c93 req-d2de0bf5-b3db-4099-a825-61ce3e99762e tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=f211d1a4-033e-4318-bffa-31f11b44bace HTTP/1.1" status: 200 len: 210 time: 0.0259733 Nov 18 18:26:07.710168 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:08.347509 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-805f5cb6-c76e-4d7f-b509-312d8d3d37fc req-d0339d89-1eda-4580-a4ef-65b0077eb6c3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:08.349009 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-805f5cb6-c76e-4d7f-b509-312d8d3d37fc req-d0339d89-1eda-4580-a4ef-65b0077eb6c3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0723934 Nov 18 18:26:08.370199 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ee82570-223e-44f9-8241-da0fb4406f9b req-571652ab-1f7e-4b69-b51e-5b05ff039ad0 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:08.371602 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6ee82570-223e-44f9-8241-da0fb4406f9b req-571652ab-1f7e-4b69-b51e-5b05ff039ad0 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 948 time: 0.0691416 Nov 18 18:26:08.429458 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-805f5cb6-c76e-4d7f-b509-312d8d3d37fc req-bf24f5d5-6e07-451a-abc5-391e3845def1 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0727539 Nov 18 18:26:08.444689 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6ee82570-223e-44f9-8241-da0fb4406f9b req-1840aff8-cd98-4512-b7f6-0f2d66ffbf8f tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656064 Nov 18 18:26:08.636583 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eada6e6-e10b-473f-9512-0e92ae9ea4a6 req-fbb47924-13ef-4988-98f8-efae6287b9cd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:08.638122 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5eada6e6-e10b-473f-9512-0e92ae9ea4a6 req-fbb47924-13ef-4988-98f8-efae6287b9cd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0609281 Nov 18 18:26:08.675311 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-283b8743-ae00-4ff2-9f98-9c0c83893f6b req-350923af-4dc7-4a16-91f3-47c5e06d4e2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:08.676532 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-283b8743-ae00-4ff2-9f98-9c0c83893f6b req-350923af-4dc7-4a16-91f3-47c5e06d4e2f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1bab99f3344342578dc7b1c29b1ced7e&device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 1098 time: 0.0544648 Nov 18 18:26:08.698734 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5eada6e6-e10b-473f-9512-0e92ae9ea4a6 req-03a6076f-3ebf-4fa2-9939-4adeface710d tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0528276 Nov 18 18:26:08.776768 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-283b8743-ae00-4ff2-9f98-9c0c83893f6b req-93478988-7804-4b2b-8a62-3ceb0ff50043 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:08.778232 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-283b8743-ae00-4ff2-9f98-9c0c83893f6b req-93478988-7804-4b2b-8a62-3ceb0ff50043 service neutron] 10.222.0.31 "GET /v2.0/networks?id=f2a08e65-1c6c-43fe-a019-78643e62bd9f HTTP/1.1" status: 200 len: 912 time: 0.0945532 Nov 18 18:26:08.843750 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-283b8743-ae00-4ff2-9f98-9c0c83893f6b req-0d93fdad-266d-42a8-834c-009e3f55a366 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f HTTP/1.1" status: 200 len: 1001 time: 0.0566227 Nov 18 18:26:08.894785 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-283b8743-ae00-4ff2-9f98-9c0c83893f6b req-92693489-2a4a-4bbb-96a1-e11133228bef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:08.896241 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-283b8743-ae00-4ff2-9f98-9c0c83893f6b req-92693489-2a4a-4bbb-96a1-e11133228bef service neutron] 10.222.0.31 "GET /v2.0/subnets?id=53535ce7-7c2a-450f-87e4-d092908ff080 HTTP/1.1" status: 200 len: 849 time: 0.0420597 Nov 18 18:26:08.945133 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-283b8743-ae00-4ff2-9f98-9c0c83893f6b req-e1e0f605-2999-4e3f-98b5-418d97621392 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:08.947112 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-283b8743-ae00-4ff2-9f98-9c0c83893f6b req-e1e0f605-2999-4e3f-98b5-418d97621392 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f2a08e65-1c6c-43fe-a019-78643e62bd9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0410378 Nov 18 18:26:09.050506 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:09.555273 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b595fefd-548d-46a8-b05a-9c7b2eb4431a req-e5c42fc9-67ee-481f-acb7-64b2993d57a2 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:09.556776 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b595fefd-548d-46a8-b05a-9c7b2eb4431a req-e5c42fc9-67ee-481f-acb7-64b2993d57a2 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 948 time: 0.0474141 Nov 18 18:26:09.604834 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b595fefd-548d-46a8-b05a-9c7b2eb4431a req-882bb0e5-b541-483f-8bdb-d3cd1400cd2d tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422661 Nov 18 18:26:09.814196 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85804c9-6de9-4363-8062-10de253c29fa req-c3a92b67-b59b-4675-96fe-cecdae45eef3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:09.815677 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d85804c9-6de9-4363-8062-10de253c29fa req-c3a92b67-b59b-4675-96fe-cecdae45eef3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0499489 Nov 18 18:26:09.861799 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d85804c9-6de9-4363-8062-10de253c29fa req-1a43eeab-f2d0-451e-82f3-6a3368a46aa4 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401578 Nov 18 18:26:09.889963 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-283b8743-ae00-4ff2-9f98-9c0c83893f6b req-138dfdce-f6cb-46e0-bcdd-282e7e03612a service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830469 Nov 18 18:26:10.175839 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:10.671986 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 180b4da0-eec7-4cb2-9366-c5b7bf587c5d details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:26:10.720002 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fbd5baf-ceb2-42a7-b63c-8b9f9aa63049 req-525fe6cc-1519-459c-a560-314a9b0d104b tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:10.721502 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2fbd5baf-ceb2-42a7-b63c-8b9f9aa63049 req-525fe6cc-1519-459c-a560-314a9b0d104b tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 948 time: 0.0509465 Nov 18 18:26:10.773863 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-283b8743-ae00-4ff2-9f98-9c0c83893f6b req-65bda181-8ac5-42d9-b8b8-74de41630606 service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1010828 Nov 18 18:26:10.776452 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2fbd5baf-ceb2-42a7-b63c-8b9f9aa63049 req-3c6b465d-7fc2-4792-9d2c-08b375abfd98 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476890 Nov 18 18:26:10.783072 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=180b4da0-eec7-4cb2-9366-c5b7bf587c5d,segment=NetworkSegment(b61c9483-d3e6-44f4-9b6d-859c2fd0b703),segment_id=b61c9483-d3e6-44f4-9b6d-859c2fd0b703)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:10.794359 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '180b4da0-eec7-4cb2-9366-c5b7bf587c5d', 'network_id': '91915bce-58a8-4d07-8162-223eca50fa5c', 'port_id': '180b4da0-eec7-4cb2-9366-c5b7bf587c5d', 'mac_address': 'fa:16:3e:0c:c9:fe', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1320, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5272349c-eb4d-440c-8d7e-450aec9b1220', 'ip_address': '192.168.233.214'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:26:10.830788 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:10.843037 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 180b4da0-eec7-4cb2-9366-c5b7bf587c5d {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:26:10.861471 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=180b4da0-eec7-4cb2-9366-c5b7bf587c5d,segment=NetworkSegment(b61c9483-d3e6-44f4-9b6d-859c2fd0b703),segment_id=b61c9483-d3e6-44f4-9b6d-859c2fd0b703)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:10.864785 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:10.913900 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=180b4da0-eec7-4cb2-9366-c5b7bf587c5d,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:10.921165 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:10.921519 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:10.921865 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:10.922202 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:10.922534 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:10.922865 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:10.923190 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:10.923515 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:10.923857 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:10.924211 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:10.924533 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:10.924851 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:10.974201 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c91abf1-b5c1-48e4-a3ed-666cb64c51b1 req-09958ed5-e2f1-4db9-b2bc-93b129016f05 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:10.975682 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6c91abf1-b5c1-48e4-a3ed-666cb64c51b1 req-09958ed5-e2f1-4db9-b2bc-93b129016f05 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0486989 Nov 18 18:26:11.024661 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6c91abf1-b5c1-48e4-a3ed-666cb64c51b1 req-afe2bcaf-e833-4492-badc-dabb2ceed620 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430839 Nov 18 18:26:11.658611 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:26:11.681785 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:26:11.682130 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device f68b74ad-70ac-4b59-8ffa-4859b8aac5a8 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:26:11.890349 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18e7793-c9a3-4fc4-9b08-c7a4b1a74e0f req-2583c7af-4544-40db-8115-cd5ed1f6c05f tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:11.892100 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a18e7793-c9a3-4fc4-9b08-c7a4b1a74e0f req-2583c7af-4544-40db-8115-cd5ed1f6c05f tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 949 time: 0.0511246 Nov 18 18:26:11.937342 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a18e7793-c9a3-4fc4-9b08-c7a4b1a74e0f req-11f3aa62-2c75-4f2e-adbe-1d49a9211e3a tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393898 Nov 18 18:26:12.028249 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['180b4da0-eec7-4cb2-9366-c5b7bf587c5d'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:26:12.138585 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a017044-f121-4b56-91c6-751531831d99 req-fab80687-06c7-40a5-a471-46b76fd8f1b4 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:12.140155 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1a017044-f121-4b56-91c6-751531831d99 req-fab80687-06c7-40a5-a471-46b76fd8f1b4 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0488527 Nov 18 18:26:12.200793 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1a017044-f121-4b56-91c6-751531831d99 req-591b81a7-92a2-4413-a49c-3fffe2107edc tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0508378 Nov 18 18:26:13.211364 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7adb4e1c-2e4d-4793-872a-c0a2e8cd5fe5 req-4c6708ab-7009-4eca-ad2a-e458bff38fc0 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:13.213346 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7adb4e1c-2e4d-4793-872a-c0a2e8cd5fe5 req-4c6708ab-7009-4eca-ad2a-e458bff38fc0 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 949 time: 0.2094646 Nov 18 18:26:13.263279 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7adb4e1c-2e4d-4793-872a-c0a2e8cd5fe5 req-372fd72b-5eff-4192-a752-c3bbcdc6fb92 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436194 Nov 18 18:26:13.365213 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e0ad26-9499-4055-bd2d-c7a8288e9bfc req-ee2bbef2-b759-4485-84ad-e205c7868961 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:13.366711 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e9e0ad26-9499-4055-bd2d-c7a8288e9bfc req-ee2bbef2-b759-4485-84ad-e205c7868961 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0973456 Nov 18 18:26:13.413105 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e9e0ad26-9499-4055-bd2d-c7a8288e9bfc req-45054479-6bd2-40a2-b576-2fcfeb91da3b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404344 Nov 18 18:26:14.007516 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 180b4da0-eec7-4cb2-9366-c5b7bf587c5d up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:26:14.056917 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:26:14.061434 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:26:14.061810 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:14.144582 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:14.170832 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '180b4da0-eec7-4cb2-9366-c5b7bf587c5d'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:26:14.173141 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aaf8d3bb-f77f-4ffc-b61d-7893e3196453" -d '{"events": [{"server_uuid": "e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0", "name": "network-vif-plugged", "status": "completed", "tag": "180b4da0-eec7-4cb2-9366-c5b7bf587c5d"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:26:14.186220 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=180b4da0-eec7-4cb2-9366-c5b7bf587c5d,segment=NetworkSegment(b61c9483-d3e6-44f4-9b6d-859c2fd0b703),segment_id=b61c9483-d3e6-44f4-9b6d-859c2fd0b703)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:14.190797 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:14.213580 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:26:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e3775484-938e-4c2b-be7c-8f6a2d2917f8 x-openstack-request-id: req-e3775484-938e-4c2b-be7c-8f6a2d2917f8 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:26:14.213876 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0", "name": "network-vif-plugged", "status": "completed", "tag": "180b4da0-eec7-4cb2-9366-c5b7bf587c5d", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:26:14.214130 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-e3775484-938e-4c2b-be7c-8f6a2d2917f8 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:26:14.214514 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '180b4da0-eec7-4cb2-9366-c5b7bf587c5d', 'code': 200} Nov 18 18:26:14.239244 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=180b4da0-eec7-4cb2-9366-c5b7bf587c5d,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:14.379958 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-057784d4-e43f-4c2b-9fbf-974e0ad81956 req-6c51b701-e463-4b66-8eda-4943fb006dc4 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:14.381454 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-057784d4-e43f-4c2b-9fbf-974e0ad81956 req-6c51b701-e463-4b66-8eda-4943fb006dc4 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 950 time: 0.0497410 Nov 18 18:26:14.402584 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c014d5-95de-4d2f-9334-2576df9b8e13 req-4cbee6d6-9033-41f3-af72-472fd1339816 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:14.404088 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-83c014d5-95de-4d2f-9334-2576df9b8e13 req-4cbee6d6-9033-41f3-af72-472fd1339816 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 1103 time: 0.0394504 Nov 18 18:26:14.430809 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-057784d4-e43f-4c2b-9fbf-974e0ad81956 req-58052d2e-665f-4228-9716-02b634a603f0 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435166 Nov 18 18:26:14.453947 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-83c014d5-95de-4d2f-9334-2576df9b8e13 req-dcd0fac8-fc96-4894-9ebd-9d2cc0c11a02 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0370336 Nov 18 18:26:15.546174 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-039ea04b-93c0-48e9-8817-b12fd0a52dcb req-d3f72d44-d5d1-45cd-95bf-dc3a1bd36ead tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:15.547636 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-039ea04b-93c0-48e9-8817-b12fd0a52dcb req-d3f72d44-d5d1-45cd-95bf-dc3a1bd36ead tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 950 time: 0.0471284 Nov 18 18:26:15.593447 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-039ea04b-93c0-48e9-8817-b12fd0a52dcb req-0581f245-8cf3-4293-a797-cda5acd5ceaa tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401182 Nov 18 18:26:16.705838 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e481bb-f4d2-43f0-a960-758cee29863b req-10124b2c-be6d-4c01-b29b-30e4df2031e8 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:16.707288 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18e481bb-f4d2-43f0-a960-758cee29863b req-10124b2c-be6d-4c01-b29b-30e4df2031e8 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 950 time: 0.0480485 Nov 18 18:26:16.753533 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18e481bb-f4d2-43f0-a960-758cee29863b req-50fd182d-7083-4531-b57c-2c752d6b6fba tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397704 Nov 18 18:26:17.872651 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1faa24-9375-4381-b0ff-623c811879f4 req-a142f4d2-cf24-4e26-b9b7-11f8a52cf11d tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:17.874123 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7f1faa24-9375-4381-b0ff-623c811879f4 req-a142f4d2-cf24-4e26-b9b7-11f8a52cf11d tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 950 time: 0.0528765 Nov 18 18:26:17.919140 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7f1faa24-9375-4381-b0ff-623c811879f4 req-78080a98-7594-4071-a57f-beb2a49bbfdf tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392339 Nov 18 18:26:18.479107 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:26:18.496275 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-038aa53b-cc1e-42ac-a1d6-95c39b0ed086 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:18.497754 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-038aa53b-cc1e-42ac-a1d6-95c39b0ed086 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/networks?id=33a318b5-ad11-45c7-9380-7c9c44d250de HTTP/1.1" status: 200 len: 814 time: 0.1115329 Nov 18 18:26:18.512293 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-c0d863ee-3c48-43b2-b182-0b93fb8357a6 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/quotas/c9e6e099470048148cdcfa828b9a32ea HTTP/1.1" status: 200 len: 375 time: 0.0087810 Nov 18 18:26:18.544259 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-71ea8bc8-09ef-41d6-9365-8082ea5ab8b2 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=c9e6e099470048148cdcfa828b9a32ea&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0265322 Nov 18 18:26:18.689173 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-fcacdade-477f-4158-b2d6-b6a7d48ff0a6 service neutron] 10.222.0.82 "GET /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1375563 Nov 18 18:26:18.782349 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-ca766513-98c0-42cf-8058-42f090bca449 service neutron] 10.222.0.82 "GET /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869744 Nov 18 18:26:18.940358 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-058ad0c2-ac33-455b-ab09-8e742c6dd99e req-d44c02fc-cd00-4962-8402-acc671341be3 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 210 time: 0.0280993 Nov 18 18:26:19.059180 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad9527af-f00b-44e7-987b-00f7fc17dc3b req-f34da7e6-1cde-4583-a426-81dfa9ed0347 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:19.066237 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ad9527af-f00b-44e7-987b-00f7fc17dc3b req-f34da7e6-1cde-4583-a426-81dfa9ed0347 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 950 time: 0.0626073 Nov 18 18:26:19.155008 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ad9527af-f00b-44e7-987b-00f7fc17dc3b req-353aadce-8ce2-459b-8f26-125220ad023b tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879121 Nov 18 18:26:19.162917 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee19dd3-b98f-4ba9-b62b-7e8e22353870 req-a94392c6-f43e-47ce-a730-a423b0465ea2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:19.170672 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aee19dd3-b98f-4ba9-b62b-7e8e22353870 req-a94392c6-f43e-47ce-a730-a423b0465ea2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 946 time: 0.0859318 Nov 18 18:26:19.225663 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aee19dd3-b98f-4ba9-b62b-7e8e22353870 req-7dd5c5d9-25e1-42e9-a19f-aa687d7cd8f3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0540695 Nov 18 18:26:19.442798 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0827f4f4-11fa-42ec-9e18-c222de1c7da0 req-2bff3847-9fb8-4cf1-847e-b64ede3f3880 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:19.444532 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0827f4f4-11fa-42ec-9e18-c222de1c7da0 req-2bff3847-9fb8-4cf1-847e-b64ede3f3880 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 950 time: 0.0522923 Nov 18 18:26:19.494479 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0827f4f4-11fa-42ec-9e18-c222de1c7da0 req-b85bf2e2-d897-4e67-b681-c259b4c42b10 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434601 Nov 18 18:26:20.038960 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-24f91898-c98f-440f-bd46-6aaa234c51bd req-93c995f2-3302-4b89-97e0-31ae9aa41b56 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 210 time: 0.0285041 Nov 18 18:26:20.192979 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-c3b373e7-9b05-4db9-8d21-63d390f7c51a tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:20.194439 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-c3b373e7-9b05-4db9-8d21-63d390f7c51a tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.31 "GET /v2.0/networks?id=33a318b5-ad11-45c7-9380-7c9c44d250de HTTP/1.1" status: 200 len: 814 time: 0.1056142 Nov 18 18:26:20.211904 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Request body: {'port': {'device_id': '663561af-f46a-4db6-823e-c06f57aba240', 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de', 'admin_state_up': True, 'tenant_id': 'c9e6e099470048148cdcfa828b9a32ea'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:26:20.319956 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Made reservation on behalf of c9e6e099470048148cdcfa828b9a32ea for: {'port': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:26:20.324070 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:20.452490 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Allocated IP 172.20.0.4 (33a318b5-ad11-45c7-9380-7c9c44d250de/15a76039-95a8-4c78-b321-326b06094f8d/acf85dcd-458e-4cbf-8320-7c37a3a988a2) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:26:20.465856 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81197fcb-2951-44b0-b384-179eb2bf3fa5 req-466d1f5f-92e0-4b1e-8e53-28a9263710f8 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:20.467386 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-81197fcb-2951-44b0-b384-179eb2bf3fa5 req-466d1f5f-92e0-4b1e-8e53-28a9263710f8 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 946 time: 0.0484462 Nov 18 18:26:20.516050 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-81197fcb-2951-44b0-b384-179eb2bf3fa5 req-8fb09ed7-ffed-4da7-b49f-b79c82b9a962 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415316 Nov 18 18:26:20.610140 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b562bfa-d078-474a-9f3e-c8ff360b344c req-85f55ef8-0aca-4e02-b9d6-27defa38eade tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:20.610377 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:20.611640 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7b562bfa-d078-474a-9f3e-c8ff360b344c req-85f55ef8-0aca-4e02-b9d6-27defa38eade tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 950 time: 0.0476799 Nov 18 18:26:20.644597 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:20.661201 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7b562bfa-d078-474a-9f3e-c8ff360b344c req-893b11a3-51bc-4bd2-8b96-417ca7816eab tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436656 Nov 18 18:26:20.681445 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Network 33a318b5-ad11-45c7-9380-7c9c44d250de is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:26:20.682769 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:26:20.686475 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:26:20.727290 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Pushing event updated for resources: {'Port': ['ID=acf85dcd-458e-4cbf-8320-7c37a3a988a2,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:20.743187 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:20.744364 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:20.759818 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-9a94e3c8-206f-4eb5-a096-54d2a7b01807 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5510902 Nov 18 18:26:20.773572 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Request body: {'port': {'device_id': '663561af-f46a-4db6-823e-c06f57aba240', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:26:20.827683 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:21.075308 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id acf85dcd-458e-4cbf-8320-7c37a3a988a2 {{(pid=102688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:26:21.083067 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:21.096245 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.provisioning_blocks [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Transition to ACTIVE for port object acf85dcd-458e-4cbf-8320-7c37a3a988a2 will not be triggered until provisioned by entity L2. {{(pid=102688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:26:21.099657 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-13993110'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:21.131655 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:21.156434 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba9ad5ac-a668-4049-89f6-8c6c0c917ae7 req-965ff183-5a9a-4b3d-9ea7-109e62ddb4e8 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:21.158617 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ba9ad5ac-a668-4049-89f6-8c6c0c917ae7 req-965ff183-5a9a-4b3d-9ea7-109e62ddb4e8 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 943 time: 0.0530910 Nov 18 18:26:21.159842 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Pushing event updated for resources: {'Port': ['ID=acf85dcd-458e-4cbf-8320-7c37a3a988a2,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:21.210210 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ba9ad5ac-a668-4049-89f6-8c6c0c917ae7 req-43840b69-f46d-4f15-87ab-e180efc704eb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431166 Nov 18 18:26:21.233772 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Attempting to bind port acf85dcd-458e-4cbf-8320-7c37a3a988a2 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:26:21.234262 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Attempting to bind port acf85dcd-458e-4cbf-8320-7c37a3a988a2 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '6f13a496-1ac6-44ee-a618-9dee39276ca6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de'}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:26:21.234589 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Attempting to bind port acf85dcd-458e-4cbf-8320-7c37a3a988a2 on network 33a318b5-ad11-45c7-9380-7c9c44d250de {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:26:21.238764 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Port acf85dcd-458e-4cbf-8320-7c37a3a988a2 on network 33a318b5-ad11-45c7-9380-7c9c44d250de not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:26:21.239105 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Attempting to bind port acf85dcd-458e-4cbf-8320-7c37a3a988a2 on network 33a318b5-ad11-45c7-9380-7c9c44d250de {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:26:21.243811 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 26, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:26:21.244187 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Checking segment: {'id': '6f13a496-1ac6-44ee-a618-9dee39276ca6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:26:21.244574 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Bound using segment: {'id': '6f13a496-1ac6-44ee-a618-9dee39276ca6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de'} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:26:21.244992 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Bound port: acf85dcd-458e-4cbf-8320-7c37a3a988a2, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f13a496-1ac6-44ee-a618-9dee39276ca6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de'}}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:26:21.245343 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:21.306341 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] For port acf85dcd-458e-4cbf-8320-7c37a3a988a2, host hv-cinder-78776, cleared binding levels {{(pid=102688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:26:21.309275 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] For port acf85dcd-458e-4cbf-8320-7c37a3a988a2, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=acf85dcd-458e-4cbf-8320-7c37a3a988a2,segment=NetworkSegment(6f13a496-1ac6-44ee-a618-9dee39276ca6),segment_id=6f13a496-1ac6-44ee-a618-9dee39276ca6)] {{(pid=102688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:26:21.313797 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-13993110'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:21.348566 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:21.349178 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:21.350554 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] 10.222.0.31 "PUT /v2.0/ports/acf85dcd-458e-4cbf-8320-7c37a3a988a2 HTTP/1.1" status: 200 len: 1093 time: 0.5811691 Nov 18 18:26:21.350993 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '663561af-f46a-4db6-823e-c06f57aba240', 'tag': 'acf85dcd-458e-4cbf-8320-7c37a3a988a2'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:26:21.353805 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22e0f476-1a7b-4626-be72-0aff2e58f7cc" -d '{"events": [{"name": "network-changed", "server_uuid": "663561af-f46a-4db6-823e-c06f57aba240", "tag": "acf85dcd-458e-4cbf-8320-7c37a3a988a2"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:26:21.375625 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69718f3c-87c3-455f-a1d4-f6e478e71ab2 service neutron] Pushing event updated for resources: {'Port': ['ID=acf85dcd-458e-4cbf-8320-7c37a3a988a2,revision_number=3']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:21.409059 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1837dcd8-2450-4362-a9ef-cfa0b861dc27 req-1c35a341-672f-48ac-b8f2-a5f6e6f40922 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:21.410545 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1837dcd8-2450-4362-a9ef-cfa0b861dc27 req-1c35a341-672f-48ac-b8f2-a5f6e6f40922 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.31 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 950 time: 0.0594773 Nov 18 18:26:21.411125 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:26:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f13a9b38-94b1-4357-9d6f-920ba7d08d69 x-openstack-request-id: req-f13a9b38-94b1-4357-9d6f-920ba7d08d69 {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:26:21.411415 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "663561af-f46a-4db6-823e-c06f57aba240", "tag": "acf85dcd-458e-4cbf-8320-7c37a3a988a2", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:26:21.411668 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-f13a9b38-94b1-4357-9d6f-920ba7d08d69 {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:26:21.412171 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '663561af-f46a-4db6-823e-c06f57aba240', 'tag': 'acf85dcd-458e-4cbf-8320-7c37a3a988a2', 'status': 'completed', 'code': 200} Nov 18 18:26:21.444238 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-eb6a26f3-be9a-4931-99aa-3b60d8b51fdf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:21.445746 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-eb6a26f3-be9a-4931-99aa-3b60d8b51fdf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c9e6e099470048148cdcfa828b9a32ea&device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 1096 time: 0.0446801 Nov 18 18:26:21.499639 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-b06f264d-5c05-450c-81ee-c223f6fe65b5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=acf85dcd-458e-4cbf-8320-7c37a3a988a2 HTTP/1.1" status: 200 len: 217 time: 0.0419226 Nov 18 18:26:21.531842 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-e9ecaa3a-1df6-4cfb-9cc7-e15aab9fbee2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:21.533288 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-e9ecaa3a-1df6-4cfb-9cc7-e15aab9fbee2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.31 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 946 time: 0.0859566 Nov 18 18:26:21.569211 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ec5ad523-6a2f-43b4-8d34-1992931ca5b7 req-b10ac227-f0e6-4370-98c0-e52804285a78 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0774755 Nov 18 18:26:21.573548 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-b094c2b8-6a7e-43eb-8929-90c7293ae980 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:21.574893 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-b094c2b8-6a7e-43eb-8929-90c7293ae980 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=15a76039-95a8-4c78-b321-326b06094f8d HTTP/1.1" status: 200 len: 854 time: 0.0594351 Nov 18 18:26:21.580518 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-1837dcd8-2450-4362-a9ef-cfa0b861dc27 req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Deleting port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:26:21.580858 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-1837dcd8-2450-4362-a9ef-cfa0b861dc27 req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:21.753090 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18db760f-816b-400f-8c09-a35b970e19f3 req-81006b7e-4aec-4c3e-b3a9-a31053c5e045 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:21.754621 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18db760f-816b-400f-8c09-a35b970e19f3 req-81006b7e-4aec-4c3e-b3a9-a31053c5e045 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 946 time: 0.1519449 Nov 18 18:26:21.772738 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-1837dcd8-2450-4362-a9ef-cfa0b861dc27 req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] For port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=180b4da0-eec7-4cb2-9366-c5b7bf587c5d,segment=NetworkSegment(b61c9483-d3e6-44f4-9b6d-859c2fd0b703),segment_id=b61c9483-d3e6-44f4-9b6d-859c2fd0b703)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:21.773102 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-1837dcd8-2450-4362-a9ef-cfa0b861dc27 req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:21.810663 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-c7756ed6-f140-47f7-a188-233a8bc2ec5a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=33a318b5-ad11-45c7-9380-7c9c44d250de&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2245016 Nov 18 18:26:21.822225 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-1837dcd8-2450-4362-a9ef-cfa0b861dc27 req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Calling delete_port for 180b4da0-eec7-4cb2-9366-c5b7bf587c5d owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:26:21.826989 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Deleting port b8ded38f-97b4-485b-9845-705c1fb9701d {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:26:21.827319 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:21.904265 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5ad523-6a2f-43b4-8d34-1992931ca5b7 req-436eb50f-f17c-4c08-b575-770b67e2890e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:21.905726 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ec5ad523-6a2f-43b4-8d34-1992931ca5b7 req-436eb50f-f17c-4c08-b575-770b67e2890e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1bab99f3344342578dc7b1c29b1ced7e&device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 1098 time: 0.0973582 Nov 18 18:26:21.926002 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-99fcac74-d5cb-4a90-8269-be91f5e5f038 service neutron] 10.222.0.31 "GET /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1066525 Nov 18 18:26:21.959313 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18db760f-816b-400f-8c09-a35b970e19f3 req-de781e48-448b-4048-a3ea-335d69ba3218 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=e5005cc1-2b9d-448f-8794-6c9f2b619e80&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1848755 Nov 18 18:26:21.968659 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb257d6-966e-4c79-9483-34bf4bada22c req-870de623-6066-4a7f-8f59-2b929ce3300e tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:21.969852 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-feb257d6-966e-4c79-9483-34bf4bada22c req-870de623-6066-4a7f-8f59-2b929ce3300e tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/ports?device_id=e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0 HTTP/1.1" status: 200 len: 950 time: 0.2310610 Nov 18 18:26:22.042026 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] For port b8ded38f-97b4-485b-9845-705c1fb9701d, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=b8ded38f-97b4-485b-9845-705c1fb9701d,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:22.042393 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:22.091090 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5ad523-6a2f-43b4-8d34-1992931ca5b7 req-98eacd23-080d-412e-a06f-2398a8a0c9fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:22.092632 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ec5ad523-6a2f-43b4-8d34-1992931ca5b7 req-98eacd23-080d-412e-a06f-2398a8a0c9fe service neutron] 10.222.0.31 "GET /v2.0/networks?id=f2a08e65-1c6c-43fe-a019-78643e62bd9f HTTP/1.1" status: 200 len: 912 time: 0.1570435 Nov 18 18:26:22.094783 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-e1e17305-11c6-4ec5-adf2-407d9f4bba73 req-1761fd63-ead2-44b4-9b0f-c6ea5c76cb8c service neutron] 10.222.0.31 "GET /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1581273 Nov 18 18:26:22.126412 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-feb257d6-966e-4c79-9483-34bf4bada22c req-b008a00d-da54-49e6-8184-8837b0201c73 tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.82 "GET /v2.0/security-groups?id=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1471679 Nov 18 18:26:22.192878 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ec5ad523-6a2f-43b4-8d34-1992931ca5b7 req-c3964752-035e-40b1-8229-18fa5d2513a2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f HTTP/1.1" status: 200 len: 1001 time: 0.0888896 Nov 18 18:26:22.202227 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e0f476-1a7b-4626-be72-0aff2e58f7cc req-f90cff92-8c22-46f2-b0e1-e3a8ba9a98eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:22.203646 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-22e0f476-1a7b-4626-be72-0aff2e58f7cc req-f90cff92-8c22-46f2-b0e1-e3a8ba9a98eb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c9e6e099470048148cdcfa828b9a32ea&device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 1096 time: 0.0530632 Nov 18 18:26:22.273920 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5ad523-6a2f-43b4-8d34-1992931ca5b7 req-c1cdeb6f-cfd0-466f-8a2e-1e001afcd3bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:22.275428 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ec5ad523-6a2f-43b4-8d34-1992931ca5b7 req-c1cdeb6f-cfd0-466f-8a2e-1e001afcd3bc service neutron] 10.222.0.31 "GET /v2.0/subnets?id=53535ce7-7c2a-450f-87e4-d092908ff080 HTTP/1.1" status: 200 len: 849 time: 0.0709131 Nov 18 18:26:22.308841 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-1837dcd8-2450-4362-a9ef-cfa0b861dc27 req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:22.320659 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['180b4da0-eec7-4cb2-9366-c5b7bf587c5d'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:26:22.363410 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e0f476-1a7b-4626-be72-0aff2e58f7cc req-9c066919-bda8-4796-b113-c023adecf513 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:22.364926 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-22e0f476-1a7b-4626-be72-0aff2e58f7cc req-9c066919-bda8-4796-b113-c023adecf513 service neutron] 10.222.0.31 "GET /v2.0/networks?id=33a318b5-ad11-45c7-9380-7c9c44d250de HTTP/1.1" status: 200 len: 916 time: 0.1524820 Nov 18 18:26:22.371372 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5ad523-6a2f-43b4-8d34-1992931ca5b7 req-0b394f43-764e-484e-9484-000e262b31c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:22.372826 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ec5ad523-6a2f-43b4-8d34-1992931ca5b7 req-0b394f43-764e-484e-9484-000e262b31c9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f2a08e65-1c6c-43fe-a019-78643e62bd9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0692976 Nov 18 18:26:22.374622 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Pushing event deleted for resources: {'Port': ['ID=180b4da0-eec7-4cb2-9366-c5b7bf587c5d,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:22.412897 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:22.413237 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:22.413588 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:22.414036 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:22.414390 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:22.414735 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:22.415698 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:22.416069 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:22.416408 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:22.416742 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:22.417077 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:22.417407 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:22.423914 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:22.424304 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:22.424710 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Floating IP 64c90213-fc61-4b3c-9477-dae011bc2072 disassociated. External IP: 172.27.1.229, port: b8ded38f-97b4-485b-9845-705c1fb9701d. Nov 18 18:26:22.424959 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Calling delete_port for b8ded38f-97b4-485b-9845-705c1fb9701d owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:26:22.449132 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-1837dcd8-2450-4362-a9ef-cfa0b861dc27 req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] No DVR routers for this DVR port 180b4da0-eec7-4cb2-9366-c5b7bf587c5d on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:26:22.451592 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-22e0f476-1a7b-4626-be72-0aff2e58f7cc req-e82933e0-0d60-435a-9158-6715db237a32 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=acf85dcd-458e-4cbf-8320-7c37a3a988a2 HTTP/1.1" status: 200 len: 217 time: 0.0687492 Nov 18 18:26:22.454933 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-1837dcd8-2450-4362-a9ef-cfa0b861dc27 req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:22.458410 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1837dcd8-2450-4362-a9ef-cfa0b861dc27 req-6efbfefd-fa00-4dd9-8763-7d6dbfd1d3db tempest-VolumesNegativeTest-862246491 tempest-VolumesNegativeTest-862246491-project] 10.222.0.31 "DELETE /v2.0/ports/180b4da0-eec7-4cb2-9366-c5b7bf587c5d HTTP/1.1" status: 204 len: 173 time: 1.0398035 Nov 18 18:26:22.460749 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0', 'name': 'network-vif-deleted', 'tag': '180b4da0-eec7-4cb2-9366-c5b7bf587c5d'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:26:22.463086 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0ac528d5-f761-4d8d-9ee5-19d66f907c38" -d '{"events": [{"server_uuid": "e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0", "name": "network-vif-deleted", "tag": "180b4da0-eec7-4cb2-9366-c5b7bf587c5d"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:26:22.472909 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e89ba82b-f229-4550-aeeb-1d986920127c req-f17b544f-ae12-4caa-99a7-b7c1197ab47d tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:22.481145 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e89ba82b-f229-4550-aeeb-1d986920127c req-f17b544f-ae12-4caa-99a7-b7c1197ab47d tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 943 time: 0.1762238 Nov 18 18:26:22.553902 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:26:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c4b740c-2e64-48a3-add6-6487b8c2ec7f x-openstack-request-id: req-0c4b740c-2e64-48a3-add6-6487b8c2ec7f {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:26:22.554205 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0", "name": "network-vif-deleted", "tag": "180b4da0-eec7-4cb2-9366-c5b7bf587c5d", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:26:22.554463 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-0c4b740c-2e64-48a3-add6-6487b8c2ec7f {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:26:22.554892 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e8b87a43-21d3-40c6-b4b6-8cc28fb3c0c0', 'name': 'network-vif-deleted', 'tag': '180b4da0-eec7-4cb2-9366-c5b7bf587c5d', 'status': 'completed', 'code': 200} Nov 18 18:26:22.569846 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e0f476-1a7b-4626-be72-0aff2e58f7cc req-7185f7a5-b19d-436d-bb39-609002b6bd9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:22.571579 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-22e0f476-1a7b-4626-be72-0aff2e58f7cc req-7185f7a5-b19d-436d-bb39-609002b6bd9f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=15a76039-95a8-4c78-b321-326b06094f8d HTTP/1.1" status: 200 len: 854 time: 0.0790148 Nov 18 18:26:22.575494 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ec5ad523-6a2f-43b4-8d34-1992931ca5b7 req-56577e76-fb1a-44b0-b303-488647da1a8a service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1866112 Nov 18 18:26:22.591162 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e89ba82b-f229-4550-aeeb-1d986920127c req-80f4c752-7037-4585-9f75-9e88d9f5d383 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1091406 Nov 18 18:26:22.632473 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-22e0f476-1a7b-4626-be72-0aff2e58f7cc req-2b2af46e-27e4-43c1-8a6e-d01267e12d61 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=33a318b5-ad11-45c7-9380-7c9c44d250de&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0441415 Nov 18 18:26:22.678181 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:22.707491 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event deleted for resources: {'Port': ['ID=b8ded38f-97b4-485b-9845-705c1fb9701d,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:22.780801 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-ec5ad523-6a2f-43b4-8d34-1992931ca5b7 req-8d8760b6-ca59-4d8e-8243-8cc31abb386a service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1832616 Nov 18 18:26:22.791678 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-22e0f476-1a7b-4626-be72-0aff2e58f7cc req-1ecc92ba-21fd-4a58-9004-20372b8e4458 service neutron] 10.222.0.31 "GET /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1492090 Nov 18 18:26:22.822036 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Router 5f928fdc-791e-4821-b088-039c140695e9 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:26:22.890294 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-22e0f476-1a7b-4626-be72-0aff2e58f7cc req-3dc29260-c6b7-41d6-8db3-6337cb619f2c service neutron] 10.222.0.31 "GET /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843675 Nov 18 18:26:23.123122 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3a638de1-d1a9-4951-82d1-6b7efe7ede5c req-06cb485e-1b32-4128-bacc-58c8f64fea4e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=05e203ea-4855-4623-b4a7-ec6ef9b4b4cb HTTP/1.1" status: 200 len: 210 time: 0.0297346 Nov 18 18:26:23.182629 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:26:23.195219 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68c7d789-0026-408f-a5cd-4eb22cd06b63 None None] Sync routers for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:26:23.208786 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68c7d789-0026-408f-a5cd-4eb22cd06b63 None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:26:23.209699 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-68c7d789-0026-408f-a5cd-4eb22cd06b63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:26:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:26:23.229703 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] No DVR routers for this DVR port b8ded38f-97b4-485b-9845-705c1fb9701d on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:26:23.233101 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:23.236972 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-73d5a2b4-eb81-4f43-9a20-8a2e35bc9a61 req-1aac9fa1-1f90-4b89-bc0b-79bf76216753 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.31 "DELETE /v2.0/ports/b8ded38f-97b4-485b-9845-705c1fb9701d HTTP/1.1" status: 204 len: 173 time: 1.6953416 Nov 18 18:26:23.356618 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-68c7d789-0026-408f-a5cd-4eb22cd06b63 None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:26:23.568788 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-68c7d789-0026-408f-a5cd-4eb22cd06b63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:24Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:26:23.600052 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68c7d789-0026-408f-a5cd-4eb22cd06b63 None None] Checking router: 5f928fdc-791e-4821-b088-039c140695e9 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:26:23.610451 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68c7d789-0026-408f-a5cd-4eb22cd06b63 None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:26:23.611066 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-68c7d789-0026-408f-a5cd-4eb22cd06b63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:26:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:26:23.740451 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-68c7d789-0026-408f-a5cd-4eb22cd06b63 None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:26:23.802428 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a751c55-a04e-4ac9-b8ce-4450a4379e2d req-a7c8d476-6c7e-49df-baf4-b0b80038d110 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:23.810022 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0a751c55-a04e-4ac9-b8ce-4450a4379e2d req-a7c8d476-6c7e-49df-baf4-b0b80038d110 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 943 time: 0.0983412 Nov 18 18:26:23.869303 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0a751c55-a04e-4ac9-b8ce-4450a4379e2d req-c1d5c43c-5a9f-4c5f-be7f-261c2fe47c51 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583947 Nov 18 18:26:24.122123 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-68c7d789-0026-408f-a5cd-4eb22cd06b63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:24Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:26:24.151550 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68c7d789-0026-408f-a5cd-4eb22cd06b63 None None] The sync data for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi is: [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:24Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:26:24.244548 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43132) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:26:24.316100 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-60dd6020-227b-4fed-b800-7f5c05932d85 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:24.347477 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-60dd6020-227b-4fed-b800-7f5c05932d85 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:24.405004 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-60dd6020-227b-4fed-b800-7f5c05932d85 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:24.407780 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-60dd6020-227b-4fed-b800-7f5c05932d85 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:24.409935 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-60dd6020-227b-4fed-b800-7f5c05932d85 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "DELETE /v2.0/security-groups/e5005cc1-2b9d-448f-8794-6c9f2b619e80 HTTP/1.1" status: 204 len: 168 time: 0.1635823 Nov 18 18:26:24.411715 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43146) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:26:24.431771 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.api.v2.resource [None req-6dfffe5a-2d38-4305-a8bb-26e888ca4230 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] show failed (client error): The resource could not be found. Nov 18 18:26:24.433558 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-6dfffe5a-2d38-4305-a8bb-26e888ca4230 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups/e5005cc1-2b9d-448f-8794-6c9f2b619e80 HTTP/1.1" status: 404 len: 347 time: 0.0198228 Nov 18 18:26:24.436203 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43148) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:26:24.438657 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60dd6020-227b-4fed-b800-7f5c05932d85 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5005cc1-2b9d-448f-8794-6c9f2b619e80,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:24.511737 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6358cad8-a340-457b-bc15-aca3f1e7f9e5 None None] New status for floating IP 64c90213-fc61-4b3c-9477-dae011bc2072: DOWN {{(pid=102691) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:26:24.556917 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'name': 'network-vif-deleted', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:26:24.559387 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-72ddadb4-b3f6-4605-bd4e-88eb5b82caa4" -d '{"events": [{"server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "name": "network-vif-deleted", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:26:24.622983 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:26:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a99ad05a-ed2c-4938-9ec4-59f649d7396e x-openstack-request-id: req-a99ad05a-ed2c-4938-9ec4-59f649d7396e {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:26:24.623386 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "05e203ea-4855-4623-b4a7-ec6ef9b4b4cb", "name": "network-vif-deleted", "tag": "b8ded38f-97b4-485b-9845-705c1fb9701d", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:26:24.623774 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-a99ad05a-ed2c-4938-9ec4-59f649d7396e {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:26:24.624373 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '05e203ea-4855-4623-b4a7-ec6ef9b4b4cb', 'name': 'network-vif-deleted', 'tag': 'b8ded38f-97b4-485b-9845-705c1fb9701d', 'status': 'completed', 'code': 200} Nov 18 18:26:24.669897 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-1378e1bb-b94a-4cef-b99b-fc46338420d3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Deleting port 0eb6c469-7c0b-4b26-8e03-8a0645e44837 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:26:24.670447 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1378e1bb-b94a-4cef-b99b-fc46338420d3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:24.757267 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1378e1bb-b94a-4cef-b99b-fc46338420d3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:24.757766 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1378e1bb-b94a-4cef-b99b-fc46338420d3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:24.786117 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-1378e1bb-b94a-4cef-b99b-fc46338420d3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Calling delete_port for 0eb6c469-7c0b-4b26-8e03-8a0645e44837 owned by network:floatingip {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:26:24.945663 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1378e1bb-b94a-4cef-b99b-fc46338420d3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:24.989925 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1378e1bb-b94a-4cef-b99b-fc46338420d3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event deleted for resources: {'Port': ['ID=0eb6c469-7c0b-4b26-8e03-8a0645e44837,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:25.049117 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e6e69e-8ce4-44b1-bdef-2b2bff0f7954 req-34544f5a-9454-49e7-a3d5-dfb2e6265b13 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:25.051356 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-86e6e69e-8ce4-44b1-bdef-2b2bff0f7954 req-34544f5a-9454-49e7-a3d5-dfb2e6265b13 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 943 time: 0.0721884 Nov 18 18:26:25.065966 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1378e1bb-b94a-4cef-b99b-fc46338420d3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.070127 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1378e1bb-b94a-4cef-b99b-fc46338420d3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.074213 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-1378e1bb-b94a-4cef-b99b-fc46338420d3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "DELETE /v2.0/floatingips/64c90213-fc61-4b3c-9477-dae011bc2072 HTTP/1.1" status: 204 len: 168 time: 0.6338208 Nov 18 18:26:25.121922 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-86e6e69e-8ce4-44b1-bdef-2b2bff0f7954 req-cfa44f2a-713d-437b-bb07-f28241be00f7 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609186 Nov 18 18:26:25.521320 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43256) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:26:25.526465 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-2563025e-bfa2-445f-8c22-53bc22b30cf1 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1725659081', 'description': 'tempest-description--1530223028'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:26:25.548716 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2563025e-bfa2-445f-8c22-53bc22b30cf1 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.616057 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2563025e-bfa2-445f-8c22-53bc22b30cf1 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.619725 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2563025e-bfa2-445f-8c22-53bc22b30cf1 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.646924 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2563025e-bfa2-445f-8c22-53bc22b30cf1 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.648231 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-2563025e-bfa2-445f-8c22-53bc22b30cf1 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.1258855 Nov 18 18:26:25.651613 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43260) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:26:25.656588 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-d3519401-1dfb-4438-8364-717cd6177baf tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Request body: {'security_group_rule': {'security_group_id': 'ba2984a9-3a0a-4797-8088-11df06eb8c5f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:26:25.663571 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2563025e-bfa2-445f-8c22-53bc22b30cf1 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ba2984a9-3a0a-4797-8088-11df06eb8c5f,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:25.685600 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d3519401-1dfb-4438-8364-717cd6177baf tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.748525 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d3519401-1dfb-4438-8364-717cd6177baf tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.753615 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d3519401-1dfb-4438-8364-717cd6177baf tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.774050 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3519401-1dfb-4438-8364-717cd6177baf tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f41ff873-dc1d-43d4-9066-1277cf75c477,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:25.778874 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d3519401-1dfb-4438-8364-717cd6177baf tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.782877 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-d3519401-1dfb-4438-8364-717cd6177baf tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1275587 Nov 18 18:26:25.782969 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43266) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:26:25.787268 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-eec7c993-c9bc-428a-a3a5-d476b27991ed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Request body: {'security_group_rule': {'security_group_id': 'ba2984a9-3a0a-4797-8088-11df06eb8c5f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:26:25.817378 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-eec7c993-c9bc-428a-a3a5-d476b27991ed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.886317 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-eec7c993-c9bc-428a-a3a5-d476b27991ed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.890595 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-eec7c993-c9bc-428a-a3a5-d476b27991ed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.908406 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eec7c993-c9bc-428a-a3a5-d476b27991ed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9153a378-a1b1-49d6-8903-026ec4409882,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:25.917075 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-eec7c993-c9bc-428a-a3a5-d476b27991ed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:25.918276 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-eec7c993-c9bc-428a-a3a5-d476b27991ed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1344724 Nov 18 18:26:25.921430 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43274) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:26:25.927118 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Request body: {'floatingip': {'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:26:25.950957 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:26.035560 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device acf85dcd-458e-4cbf-8320-7c37a3a988a2 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:26:26.037759 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b8ded38f-97b4-485b-9845-705c1fb9701d no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:26:26.060283 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:26.074820 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: b8ded38f-97b4-485b-9845-705c1fb9701d {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:26:26.075173 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device b8ded38f-97b4-485b-9845-705c1fb9701d not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:26:26.075606 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 180b4da0-eec7-4cb2-9366-c5b7bf587c5d no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:26:26.098434 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: 180b4da0-eec7-4cb2-9366-c5b7bf587c5d {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:26:26.098434 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 180b4da0-eec7-4cb2-9366-c5b7bf587c5d not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:26:26.185247 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Allocated IP 172.27.1.78 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/0d549f55-e60c-4f50-a96c-c186bae633c9) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:26:26.193054 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port acf85dcd-458e-4cbf-8320-7c37a3a988a2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=acf85dcd-458e-4cbf-8320-7c37a3a988a2,segment=NetworkSegment(6f13a496-1ac6-44ee-a618-9dee39276ca6),segment_id=6f13a496-1ac6-44ee-a618-9dee39276ca6)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:26.205002 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': 'acf85dcd-458e-4cbf-8320-7c37a3a988a2', 'network_id': '33a318b5-ad11-45c7-9380-7c9c44d250de', 'port_id': 'acf85dcd-458e-4cbf-8320-7c37a3a988a2', 'mac_address': 'fa:16:3e:04:1e:25', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1322, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '15a76039-95a8-4c78-b321-326b06094f8d', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:26:26.249055 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:26.280662 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id acf85dcd-458e-4cbf-8320-7c37a3a988a2 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:26:26.313151 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port acf85dcd-458e-4cbf-8320-7c37a3a988a2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=acf85dcd-458e-4cbf-8320-7c37a3a988a2,segment=NetworkSegment(6f13a496-1ac6-44ee-a618-9dee39276ca6),segment_id=6f13a496-1ac6-44ee-a618-9dee39276ca6)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:26.317886 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:26.335728 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c0518fb-642f-4ab5-9c75-d7e95798315b req-86317570-d404-42e1-ba2e-832f04dd1f6a tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:26.337612 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7c0518fb-642f-4ab5-9c75-d7e95798315b req-86317570-d404-42e1-ba2e-832f04dd1f6a tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 943 time: 0.1232305 Nov 18 18:26:26.372291 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=acf85dcd-458e-4cbf-8320-7c37a3a988a2,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:26.382993 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:26.425782 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7c0518fb-642f-4ab5-9c75-d7e95798315b req-9820ea10-6013-4c71-82cd-fb8781921cfd tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0755286 Nov 18 18:26:26.441668 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:26.484932 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:26:26.487714 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:26:26.494567 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:26:26.497870 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event updated for resources: {'Port': ['ID=0d549f55-e60c-4f50-a96c-c186bae633c9,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:26.581768 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:26.614902 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:26.618282 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['acf85dcd-458e-4cbf-8320-7c37a3a988a2'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:26:26.766547 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:26.772171 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:26.840718 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event updated for resources: {'Port': ['ID=0d549f55-e60c-4f50-a96c-c186bae633c9,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:26.854039 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:26.868857 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:26.870146 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-b0b1f2b4-61c5-4629-ac59-b9faffb8890e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 0.9475503 Nov 18 18:26:27.014706 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-dc6a62fc-efa0-4e96-aad2-c8e873423de6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1725659081&fields=id&tenant_id=6a79674a70ee4ad7acedc7d4896b413e HTTP/1.1" status: 200 len: 267 time: 0.0417666 Nov 18 18:26:27.120849 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da929790-2377-42c9-b3e6-b4086f4050bb req-57f588a5-7504-4ac6-914a-e8fc9929b6cb tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:27.122300 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-57f588a5-7504-4ac6-914a-e8fc9929b6cb tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 817 time: 0.1012039 Nov 18 18:26:27.137114 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-390e6780-20d0-4f10-850b-ca12153c58ca tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/quotas/6a79674a70ee4ad7acedc7d4896b413e HTTP/1.1" status: 200 len: 375 time: 0.0092158 Nov 18 18:26:27.185372 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-da783e85-9a0f-4379-977d-fd773cea14a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0432620 Nov 18 18:26:27.277880 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-bffebf13-30fa-41cd-a3a6-c689613c9616 service neutron] 10.222.0.82 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811558 Nov 18 18:26:27.369526 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-852783e5-571f-458a-bb89-ec8224809824 service neutron] 10.222.0.82 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858316 Nov 18 18:26:27.541012 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4c49470a-2252-4051-8897-c05e2ec853ac req-fed3aefc-7aff-456b-9412-6ce9d4892e04 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 210 time: 0.0360174 Nov 18 18:26:27.582210 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43330) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:26:27.599858 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b10c831-a840-472f-b46c-df1ffa533b68 req-f01b7c45-e93b-4dca-82d1-717c37154740 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:27.601425 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8b10c831-a840-472f-b46c-df1ffa533b68 req-f01b7c45-e93b-4dca-82d1-717c37154740 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 944 time: 0.0641112 Nov 18 18:26:27.653357 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8b10c831-a840-472f-b46c-df1ffa533b68 req-33c25efe-6b35-4123-a7f9-69f1bef77a0c tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441289 Nov 18 18:26:27.732184 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-e762274f-22da-4280-8a0e-21280f640711 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=45bd08fb8c564fcf9a270b30944c6a8f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1487794 Nov 18 18:26:27.734573 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43338) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:26:27.787811 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f2962919-7994-4551-8ff6-184c2b67d843 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:27.813820 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f2962919-7994-4551-8ff6-184c2b67d843 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:27.863819 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f2962919-7994-4551-8ff6-184c2b67d843 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:27.866558 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-f2962919-7994-4551-8ff6-184c2b67d843 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:27.867708 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-f2962919-7994-4551-8ff6-184c2b67d843 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f HTTP/1.1" status: 204 len: 168 time: 0.1322446 Nov 18 18:26:27.876404 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2962919-7994-4551-8ff6-184c2b67d843 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c14fca9e-7e07-41fe-b2d6-a5dd33d1ef2f,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:28.065871 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device acf85dcd-458e-4cbf-8320-7c37a3a988a2 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:26:28.117724 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port acf85dcd-458e-4cbf-8320-7c37a3a988a2 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:26:28.122164 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port acf85dcd-458e-4cbf-8320-7c37a3a988a2 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:26:28.122535 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:28.201184 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:28.222744 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '663561af-f46a-4db6-823e-c06f57aba240', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'acf85dcd-458e-4cbf-8320-7c37a3a988a2'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:26:28.224991 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1b80141f-cad5-48c9-9ec4-620963a47812" -d '{"events": [{"server_uuid": "663561af-f46a-4db6-823e-c06f57aba240", "name": "network-vif-plugged", "status": "completed", "tag": "acf85dcd-458e-4cbf-8320-7c37a3a988a2"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:26:28.237528 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port acf85dcd-458e-4cbf-8320-7c37a3a988a2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=acf85dcd-458e-4cbf-8320-7c37a3a988a2,segment=NetworkSegment(6f13a496-1ac6-44ee-a618-9dee39276ca6),segment_id=6f13a496-1ac6-44ee-a618-9dee39276ca6)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:28.242562 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:28.265814 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:26:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d998e116-e44a-43df-b17a-8a16ea4ca295 x-openstack-request-id: req-d998e116-e44a-43df-b17a-8a16ea4ca295 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:26:28.266130 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "663561af-f46a-4db6-823e-c06f57aba240", "name": "network-vif-plugged", "status": "completed", "tag": "acf85dcd-458e-4cbf-8320-7c37a3a988a2", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:26:28.266389 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-d998e116-e44a-43df-b17a-8a16ea4ca295 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:26:28.266780 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '663561af-f46a-4db6-823e-c06f57aba240', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'acf85dcd-458e-4cbf-8320-7c37a3a988a2', 'code': 200} Nov 18 18:26:28.292832 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=acf85dcd-458e-4cbf-8320-7c37a3a988a2,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:28.554524 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-822a2534-4fc8-43bb-913f-af034e6a498f req-9a84c777-3b3c-4e59-ac4a-f4bc122c0e45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:28.556059 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-822a2534-4fc8-43bb-913f-af034e6a498f req-9a84c777-3b3c-4e59-ac4a-f4bc122c0e45 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 1098 time: 0.1397974 Nov 18 18:26:28.616614 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-822a2534-4fc8-43bb-913f-af034e6a498f req-70901cd5-e0a5-4982-919f-99ff64d22928 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473325 Nov 18 18:26:28.622950 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da929790-2377-42c9-b3e6-b4086f4050bb req-6b992fe8-77dd-4b71-bc19-f11b863444b2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:28.624893 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-6b992fe8-77dd-4b71-bc19-f11b863444b2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.31 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 817 time: 0.1113102 Nov 18 18:26:28.652978 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-959efd28-d6c2-4c63-ac1b-cfc53c436e56 req-cf4977d3-c4c0-41bc-b4ad-b0986450c0eb tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 210 time: 0.0257115 Nov 18 18:26:28.770296 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-185237a8-dc8c-4865-b08d-132315a53ec9 req-18d358e2-96c0-43e7-8cbb-49cd183dabe7 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:28.772076 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-185237a8-dc8c-4865-b08d-132315a53ec9 req-18d358e2-96c0-43e7-8cbb-49cd183dabe7 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 945 time: 0.0494077 Nov 18 18:26:28.817929 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-185237a8-dc8c-4865-b08d-132315a53ec9 req-0086ea65-b11e-4a8f-a190-e79c88a45581 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399981 Nov 18 18:26:28.917112 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-b58dd222-4f32-43ea-8d4b-fbb65773e126 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6a79674a70ee4ad7acedc7d4896b413e HTTP/1.1" status: 200 len: 380 time: 0.0560973 Nov 18 18:26:28.932333 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-da929790-2377-42c9-b3e6-b4086f4050bb req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Request body: {'port': {'device_id': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'admin_state_up': True, 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'security_groups': ['ba2984a9-3a0a-4797-8088-11df06eb8c5f']}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:26:29.035353 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-da929790-2377-42c9-b3e6-b4086f4050bb req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Made reservation on behalf of 6a79674a70ee4ad7acedc7d4896b413e for: {'port': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:26:29.038781 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-da929790-2377-42c9-b3e6-b4086f4050bb req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:29.161086 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [req-da929790-2377-42c9-b3e6-b4086f4050bb req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Allocated IP 172.20.0.3 (d845755f-6a59-4935-8123-1a70c6e45968/690618f7-2d23-41bc-866f-0d343d1149d2/02e0aac7-3022-49e1-8484-d2e56545e298) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:26:29.290690 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-da929790-2377-42c9-b3e6-b4086f4050bb req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:29.326811 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-da929790-2377-42c9-b3e6-b4086f4050bb req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:29.365112 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-da929790-2377-42c9-b3e6-b4086f4050bb req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Network d845755f-6a59-4935-8123-1a70c6e45968 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:26:29.368030 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [req-da929790-2377-42c9-b3e6-b4086f4050bb req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:26:29.372228 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-da929790-2377-42c9-b3e6-b4086f4050bb req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:26:29.400482 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event updated for resources: {'Port': ['ID=02e0aac7-3022-49e1-8484-d2e56545e298,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:29.427790 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da929790-2377-42c9-b3e6-b4086f4050bb req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:29.428442 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-da929790-2377-42c9-b3e6-b4086f4050bb req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:29.445668 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-8ed4f3db-44de-4b9f-a378-ade3a5ded1a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5173526 Nov 18 18:26:29.463001 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Request body: {'port': {'device_id': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:26:29.520999 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:29.643800 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-98b59d0f-d6be-4733-a63d-0f68d7009796 None None] Provisioning complete for port 02e0aac7-3022-49e1-8484-d2e56545e298 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:26:29.644382 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-98b59d0f-d6be-4733-a63d-0f68d7009796 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:29.680942 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-98b59d0f-d6be-4733-a63d-0f68d7009796 None None] Port 02e0aac7-3022-49e1-8484-d2e56545e298 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:26:29.778042 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 02e0aac7-3022-49e1-8484-d2e56545e298 {{(pid=102688) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:26:29.781771 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec238af-334d-48d5-8aed-62a467c9c1a0 req-9c24647e-9653-436b-b288-71e8b3c9116f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:29.783280 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eec238af-334d-48d5-8aed-62a467c9c1a0 req-9c24647e-9653-436b-b288-71e8b3c9116f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 931 time: 0.0576143 Nov 18 18:26:29.786275 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:29.799497 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.provisioning_blocks [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Transition to ACTIVE for port object 02e0aac7-3022-49e1-8484-d2e56545e298 will not be triggered until provisioned by entity L2. {{(pid=102688) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:26:29.802819 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-13993110'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:29.832981 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eec238af-334d-48d5-8aed-62a467c9c1a0 req-c5a94c69-dd18-4402-9e15-40e47d238f5d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430167 Nov 18 18:26:29.874028 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Pushing event updated for resources: {'Port': ['ID=02e0aac7-3022-49e1-8484-d2e56545e298,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:29.933447 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Attempting to bind port 02e0aac7-3022-49e1-8484-d2e56545e298 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:26:29.933800 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Attempting to bind port 02e0aac7-3022-49e1-8484-d2e56545e298 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:26:29.934131 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Attempting to bind port 02e0aac7-3022-49e1-8484-d2e56545e298 on network d845755f-6a59-4935-8123-1a70c6e45968 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:26:29.938710 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Port 02e0aac7-3022-49e1-8484-d2e56545e298 on network d845755f-6a59-4935-8123-1a70c6e45968 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:26:29.939032 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Attempting to bind port 02e0aac7-3022-49e1-8484-d2e56545e298 on network d845755f-6a59-4935-8123-1a70c6e45968 {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:26:29.944556 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 26, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:26:29.944949 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Checking segment: {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:26:29.945341 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Bound using segment: {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'} {{(pid=102688) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:26:29.945771 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.managers [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Bound port: 02e0aac7-3022-49e1-8484-d2e56545e298, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1342, 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968'}}] {{(pid=102688) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:26:29.946129 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:29.960442 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-713bdd46-5679-4f42-896a-b15c41cad7ed req-8af52269-ff10-48db-8721-8d2f1b68efa3 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:29.968967 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-713bdd46-5679-4f42-896a-b15c41cad7ed req-8af52269-ff10-48db-8721-8d2f1b68efa3 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 945 time: 0.0575454 Nov 18 18:26:30.018749 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, cleared binding levels {{(pid=102688) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:26:30.020721 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-713bdd46-5679-4f42-896a-b15c41cad7ed req-f6280557-5f56-4cc0-8258-0c21a27605ca tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503063 Nov 18 18:26:30.022094 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=02e0aac7-3022-49e1-8484-d2e56545e298,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102688) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:26:30.028882 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-13993110'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:30.065147 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:30.065870 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:30.067145 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] 10.222.0.31 "PUT /v2.0/ports/02e0aac7-3022-49e1-8484-d2e56545e298 HTTP/1.1" status: 200 len: 1093 time: 0.6091108 Nov 18 18:26:30.067589 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:26:30.069835 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8be1bfac-e649-4628-95aa-1c7054c20c92" -d '{"events": [{"name": "network-changed", "server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:26:30.097098 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cd068c7-ef15-4ab3-bea0-23512d864001 service neutron] Pushing event updated for resources: {'Port': ['ID=02e0aac7-3022-49e1-8484-d2e56545e298,revision_number=3']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:30.163209 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da929790-2377-42c9-b3e6-b4086f4050bb req-09cbde6d-2353-4e32-a224-6f00afc56b6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:30.164852 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-09cbde6d-2353-4e32-a224-6f00afc56b6b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 1096 time: 0.0437586 Nov 18 18:26:30.218514 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-d437c5db-8c44-4cbf-a81f-e6404c1a1c2c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=02e0aac7-3022-49e1-8484-d2e56545e298 HTTP/1.1" status: 200 len: 217 time: 0.0383410 Nov 18 18:26:30.267235 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:26:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15627d9d-b447-48ed-8dbc-a146d3f09dc0 x-openstack-request-id: req-15627d9d-b447-48ed-8dbc-a146d3f09dc0 {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:26:30.267547 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:26:30.267803 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-15627d9d-b447-48ed-8dbc-a146d3f09dc0 {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:26:30.268228 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298', 'status': 'completed', 'code': 200} Nov 18 18:26:30.285066 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da929790-2377-42c9-b3e6-b4086f4050bb req-ab0ca52b-4101-4858-998f-ce069b05cbc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:30.286529 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-ab0ca52b-4101-4858-998f-ce069b05cbc1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 200 len: 856 time: 0.0474353 Nov 18 18:26:30.333603 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da929790-2377-42c9-b3e6-b4086f4050bb req-0530714e-78ad-45ab-ad95-82cae7b82fc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:30.335081 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-0530714e-78ad-45ab-ad95-82cae7b82fc3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d845755f-6a59-4935-8123-1a70c6e45968&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392475 Nov 18 18:26:30.436693 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-9687be19-0d8e-42a0-abae-ab9475780d4f service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825157 Nov 18 18:26:30.532861 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-da929790-2377-42c9-b3e6-b4086f4050bb req-47a4df6a-d71d-4026-8430-2b8720a1207c service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889544 Nov 18 18:26:30.625915 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8be1bfac-e649-4628-95aa-1c7054c20c92 req-c1468eb8-e71f-417b-912a-15afcf2113c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:30.627368 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-8be1bfac-e649-4628-95aa-1c7054c20c92 req-c1468eb8-e71f-417b-912a-15afcf2113c7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 1096 time: 0.0398331 Nov 18 18:26:30.730799 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8be1bfac-e649-4628-95aa-1c7054c20c92 req-c9944a91-cbc4-494e-b8f1-ae179ea04088 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:30.732338 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-8be1bfac-e649-4628-95aa-1c7054c20c92 req-c9944a91-cbc4-494e-b8f1-ae179ea04088 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 919 time: 0.0828745 Nov 18 18:26:30.777457 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-8be1bfac-e649-4628-95aa-1c7054c20c92 req-c880e554-0119-4cb7-a74e-3baa9122d05c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=02e0aac7-3022-49e1-8484-d2e56545e298 HTTP/1.1" status: 200 len: 217 time: 0.0359378 Nov 18 18:26:30.825783 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8be1bfac-e649-4628-95aa-1c7054c20c92 req-cd42de80-8ed2-4f59-8e7f-ab39eb31a98b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:30.827167 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-8be1bfac-e649-4628-95aa-1c7054c20c92 req-cd42de80-8ed2-4f59-8e7f-ab39eb31a98b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 200 len: 856 time: 0.0423753 Nov 18 18:26:30.874394 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8be1bfac-e649-4628-95aa-1c7054c20c92 req-ed1d07fb-da6e-4cdf-b98e-73f87811a5a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:30.875919 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-8be1bfac-e649-4628-95aa-1c7054c20c92 req-ed1d07fb-da6e-4cdf-b98e-73f87811a5a7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d845755f-6a59-4935-8123-1a70c6e45968&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0391476 Nov 18 18:26:30.956949 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1f6c28-b576-4f38-8590-d2f916cbba52 req-625647c5-7c6a-472b-96f6-c3219f55b22d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:30.958459 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bc1f6c28-b576-4f38-8590-d2f916cbba52 req-625647c5-7c6a-472b-96f6-c3219f55b22d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0513561 Nov 18 18:26:30.969988 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-8be1bfac-e649-4628-95aa-1c7054c20c92 req-96ae2fe2-6744-4abf-8a12-adf1dc064d7c service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860562 Nov 18 18:26:31.005437 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bc1f6c28-b576-4f38-8590-d2f916cbba52 req-ad342cd3-0868-4702-9029-3e6356803341 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403223 Nov 18 18:26:31.066326 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-8be1bfac-e649-4628-95aa-1c7054c20c92 req-b893e8d6-e6b5-451c-934f-8e9d908e41e5 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847373 Nov 18 18:26:31.137938 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-092968a3-5ed2-4856-aba9-3b97d1405bce req-3362e491-2666-4a63-9c07-f4747eac0d5d tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:31.139432 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-092968a3-5ed2-4856-aba9-3b97d1405bce req-3362e491-2666-4a63-9c07-f4747eac0d5d tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 945 time: 0.0482340 Nov 18 18:26:31.185784 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-092968a3-5ed2-4856-aba9-3b97d1405bce req-e38cabd4-cc4b-42c6-a9fe-ec1af6877678 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405090 Nov 18 18:26:32.123245 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28daeeac-baec-4e42-941d-64a8a2435304 req-27063658-bed9-4158-bdc3-397bb71ce704 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:32.124751 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-28daeeac-baec-4e42-941d-64a8a2435304 req-27063658-bed9-4158-bdc3-397bb71ce704 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0498443 Nov 18 18:26:32.174057 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-28daeeac-baec-4e42-941d-64a8a2435304 req-339f6cd6-9adb-457a-b48b-49d50218bed7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433578 Nov 18 18:26:33.292237 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec05ef94-b2b2-4be2-a629-11985ed85d0c req-2a29f069-2482-46c4-81ce-a0b71f36e5bd tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:33.293711 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ec05ef94-b2b2-4be2-a629-11985ed85d0c req-2a29f069-2482-46c4-81ce-a0b71f36e5bd tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0479436 Nov 18 18:26:33.339658 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ec05ef94-b2b2-4be2-a629-11985ed85d0c req-c8a710c0-e24c-49d7-bfe8-2c5323a27e99 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400186 Nov 18 18:26:33.990854 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-6f4adc78-c45b-4ae7-954e-04764110d6c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:34.098394 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 02e0aac7-3022-49e1-8484-d2e56545e298 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:26:34.191822 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=02e0aac7-3022-49e1-8484-d2e56545e298,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:34.202707 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '02e0aac7-3022-49e1-8484-d2e56545e298', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'port_id': '02e0aac7-3022-49e1-8484-d2e56545e298', 'mac_address': 'fa:16:3e:bb:bc:02', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1342, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:26:34.238418 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:34.250813 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 02e0aac7-3022-49e1-8484-d2e56545e298 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:26:34.268996 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=02e0aac7-3022-49e1-8484-d2e56545e298,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:34.273098 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:34.317601 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=02e0aac7-3022-49e1-8484-d2e56545e298,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:34.457227 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87615d4b-3d0f-4325-899b-73091935db46 req-34ef002a-4c99-48d5-ab58-64a271c527dc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:34.458740 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-87615d4b-3d0f-4325-899b-73091935db46 req-34ef002a-4c99-48d5-ab58-64a271c527dc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 944 time: 0.0501373 Nov 18 18:26:34.504799 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-87615d4b-3d0f-4325-899b-73091935db46 req-07d6fc7c-60d9-4303-9d34-589f702c373e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394874 Nov 18 18:26:34.542674 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['02e0aac7-3022-49e1-8484-d2e56545e298'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:26:35.623448 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec484f48-e8c1-4c71-a3cd-cff92525f186 req-cac6960f-9150-4af6-b3e9-24fe78a99863 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:35.624914 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ec484f48-e8c1-4c71-a3cd-cff92525f186 req-cac6960f-9150-4af6-b3e9-24fe78a99863 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 944 time: 0.0508654 Nov 18 18:26:35.671974 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ec484f48-e8c1-4c71-a3cd-cff92525f186 req-0b082b27-2535-4a70-9d76-ee1fc37226e6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412343 Nov 18 18:26:36.111040 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 02e0aac7-3022-49e1-8484-d2e56545e298 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:26:36.158259 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port 02e0aac7-3022-49e1-8484-d2e56545e298 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:26:36.162345 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 02e0aac7-3022-49e1-8484-d2e56545e298 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:26:36.162709 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:36.241123 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:36.263425 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:26:36.265639 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-55271f18-3fa4-4d64-aede-79d516ae63f0" -d '{"events": [{"server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "name": "network-vif-plugged", "status": "completed", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:26:36.277982 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=02e0aac7-3022-49e1-8484-d2e56545e298,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:36.282123 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:36.305338 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:26:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3aab3ab0-bacf-49ea-8e12-96e5d0126c43 x-openstack-request-id: req-3aab3ab0-bacf-49ea-8e12-96e5d0126c43 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:26:36.305641 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "name": "network-vif-plugged", "status": "completed", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:26:36.306415 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-3aab3ab0-bacf-49ea-8e12-96e5d0126c43 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:26:36.306797 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298', 'code': 200} Nov 18 18:26:36.332133 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=02e0aac7-3022-49e1-8484-d2e56545e298,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:36.436913 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-593c4062-7c2e-40e7-b2e6-bf7c81c8bab2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:36.678855 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-581b9373-d212-4efd-8c27-85e6eaa36a3e req-c1b88413-d629-4243-8240-2f55947310af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:36.680250 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-581b9373-d212-4efd-8c27-85e6eaa36a3e req-c1b88413-d629-4243-8240-2f55947310af service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 1098 time: 0.2336612 Nov 18 18:26:36.728366 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-581b9373-d212-4efd-8c27-85e6eaa36a3e req-9a7ff90b-0070-4c33-bb6a-cff9d65b2e4b service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392570 Nov 18 18:26:36.789221 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d5db7a6-f19b-4e96-bfdc-c6d231b3b5ef req-302513ea-d180-40b6-ad42-5eba6231590d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:36.791217 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6d5db7a6-f19b-4e96-bfdc-c6d231b3b5ef req-302513ea-d180-40b6-ad42-5eba6231590d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0483284 Nov 18 18:26:36.836369 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6d5db7a6-f19b-4e96-bfdc-c6d231b3b5ef req-44fe5285-b457-4db5-9dbe-259cae2e6542 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389788 Nov 18 18:26:37.712003 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:37.957843 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-321e0003-695a-48bc-aa21-214eaf055f5c req-12e92107-9cc4-4d44-bbe4-ad5043d04d84 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:37.958570 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-321e0003-695a-48bc-aa21-214eaf055f5c req-12e92107-9cc4-4d44-bbe4-ad5043d04d84 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0491803 Nov 18 18:26:38.008664 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-321e0003-695a-48bc-aa21-214eaf055f5c req-f350c3ef-9f21-442a-9d47-8ef7e71f875a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442398 Nov 18 18:26:39.054635 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:39.129249 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ee106f-0147-4ed0-9103-112cc180b649 req-a40da069-cda4-4606-a320-d4848140b3e5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:39.130724 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-10ee106f-0147-4ed0-9103-112cc180b649 req-a40da069-cda4-4606-a320-d4848140b3e5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0484316 Nov 18 18:26:39.177513 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-10ee106f-0147-4ed0-9103-112cc180b649 req-9b310a57-09b5-402e-858b-259cc5e3e017 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403297 Nov 18 18:26:39.289594 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a04c0d4d-17d1-4c19-abca-a8c01279eef5 req-2b8f9ebb-b93d-49a9-a3f3-344485a7927d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:39.290954 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a04c0d4d-17d1-4c19-abca-a8c01279eef5 req-2b8f9ebb-b93d-49a9-a3f3-344485a7927d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0480070 Nov 18 18:26:39.299325 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43416) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:26:39.303495 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-b01d9d53-aec5-403f-a055-f0c793ea627a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Request body: {'floatingip': {'port_id': '02e0aac7-3022-49e1-8484-d2e56545e298'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:26:39.344924 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b01d9d53-aec5-403f-a055-f0c793ea627a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:39.752099 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b01d9d53-aec5-403f-a055-f0c793ea627a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:39.755433 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b01d9d53-aec5-403f-a055-f0c793ea627a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:39.847538 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [None req-b01d9d53-aec5-403f-a055-f0c793ea627a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Floating IP edb62647-cddf-4ee8-9e73-2e273a7eb213 associated. External IP: 172.27.1.78, port: 02e0aac7-3022-49e1-8484-d2e56545e298. Nov 18 18:26:40.044531 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b01d9d53-aec5-403f-a055-f0c793ea627a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Router 5f928fdc-791e-4821-b088-039c140695e9 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:26:40.146215 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b01d9d53-aec5-403f-a055-f0c793ea627a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:26:40.151433 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b01d9d53-aec5-403f-a055-f0c793ea627a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:40.156457 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec2d0ee6-9030-4e52-a86b-58cab7d595d8 None None] Sync routers for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:26:40.178908 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec2d0ee6-9030-4e52-a86b-58cab7d595d8 None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:26:40.179607 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-ec2d0ee6-9030-4e52-a86b-58cab7d595d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:26:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:26:40.180688 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-b01d9d53-aec5-403f-a055-f0c793ea627a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "PUT /v2.0/floatingips/edb62647-cddf-4ee8-9e73-2e273a7eb213 HTTP/1.1" status: 200 len: 990 time: 0.8803463 Nov 18 18:26:40.181714 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:26:40.184359 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c01e79d-a7af-46c2-be5d-e81e6b8c1083" -d '{"events": [{"name": "network-changed", "server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:26:40.221815 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:40.280987 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:26:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95706f9d-e2aa-453a-aded-090136f8a6ac x-openstack-request-id: req-95706f9d-e2aa-453a-aded-090136f8a6ac {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:26:40.281291 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:26:40.281551 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-95706f9d-e2aa-453a-aded-090136f8a6ac {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:26:40.282288 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298', 'status': 'completed', 'code': 200} Nov 18 18:26:40.292733 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-ec2d0ee6-9030-4e52-a86b-58cab7d595d8 None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:26:40.665308 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-ec2d0ee6-9030-4e52-a86b-58cab7d595d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': 'edb62647-cddf-4ee8-9e73-2e273a7eb213', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'floating_ip_address': '172.27.1.78', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '5f928fdc-791e-4821-b088-039c140695e9', 'port_id': '02e0aac7-3022-49e1-8484-d2e56545e298', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 525, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'mac_address': 'fa:16:3e:bb:bc:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:26:26Z', 'updated_at': '2021-11-18T18:26:39Z', 'revision_number': 1, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:24Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:26:40.691247 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec2d0ee6-9030-4e52-a86b-58cab7d595d8 None None] Checking router: 5f928fdc-791e-4821-b088-039c140695e9 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:26:40.700083 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec2d0ee6-9030-4e52-a86b-58cab7d595d8 None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:26:40.700684 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-ec2d0ee6-9030-4e52-a86b-58cab7d595d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:26:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:26:40.803822 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-ec2d0ee6-9030-4e52-a86b-58cab7d595d8 None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:26:41.022029 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-ec2d0ee6-9030-4e52-a86b-58cab7d595d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': 'edb62647-cddf-4ee8-9e73-2e273a7eb213', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'floating_ip_address': '172.27.1.78', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '5f928fdc-791e-4821-b088-039c140695e9', 'port_id': '02e0aac7-3022-49e1-8484-d2e56545e298', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 525, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'mac_address': 'fa:16:3e:bb:bc:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:26:26Z', 'updated_at': '2021-11-18T18:26:39Z', 'revision_number': 1, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:24Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:26:41.047570 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec2d0ee6-9030-4e52-a86b-58cab7d595d8 None None] The sync data for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi is: [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': 'edb62647-cddf-4ee8-9e73-2e273a7eb213', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'floating_ip_address': '172.27.1.78', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '5f928fdc-791e-4821-b088-039c140695e9', 'port_id': '02e0aac7-3022-49e1-8484-d2e56545e298', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 525, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'mac_address': 'fa:16:3e:bb:bc:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:26:26Z', 'updated_at': '2021-11-18T18:26:39Z', 'revision_number': 1, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:24Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:26:41.220932 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f4792ee-03ee-4be9-b5a7-90e29ec7a81c None None] New status for floating IP edb62647-cddf-4ee8-9e73-2e273a7eb213: ACTIVE {{(pid=102691) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:26:42.318998 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c01e79d-a7af-46c2-be5d-e81e6b8c1083 req-848b8ddc-7c5f-4183-8584-f7c87e785fb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:42.320379 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2c01e79d-a7af-46c2-be5d-e81e6b8c1083 req-848b8ddc-7c5f-4183-8584-f7c87e785fb2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 1098 time: 0.0389240 Nov 18 18:26:42.412987 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c01e79d-a7af-46c2-be5d-e81e6b8c1083 req-41fab284-18b2-4675-af02-e92eb2b5f7ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:42.414428 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2c01e79d-a7af-46c2-be5d-e81e6b8c1083 req-41fab284-18b2-4675-af02-e92eb2b5f7ee service neutron] 10.222.0.31 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 919 time: 0.0853238 Nov 18 18:26:42.482836 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2c01e79d-a7af-46c2-be5d-e81e6b8c1083 req-26e8937b-b286-486a-81b1-43a9aabcc98d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=02e0aac7-3022-49e1-8484-d2e56545e298 HTTP/1.1" status: 200 len: 1000 time: 0.0584183 Nov 18 18:26:42.536933 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c01e79d-a7af-46c2-be5d-e81e6b8c1083 req-049c34c9-da20-4cae-92e3-cfe7b3ee3c2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:42.538340 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2c01e79d-a7af-46c2-be5d-e81e6b8c1083 req-049c34c9-da20-4cae-92e3-cfe7b3ee3c2d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 200 len: 856 time: 0.0464859 Nov 18 18:26:42.585832 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c01e79d-a7af-46c2-be5d-e81e6b8c1083 req-57b5479a-a523-4156-a199-f86410b23669 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:42.587310 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2c01e79d-a7af-46c2-be5d-e81e6b8c1083 req-57b5479a-a523-4156-a199-f86410b23669 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d845755f-6a59-4935-8123-1a70c6e45968&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0404303 Nov 18 18:26:42.676460 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2c01e79d-a7af-46c2-be5d-e81e6b8c1083 req-680dcf39-4a83-49d9-a826-3a804194a6f5 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0804515 Nov 18 18:26:42.781104 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-2c01e79d-a7af-46c2-be5d-e81e6b8c1083 req-d249561a-699d-46d7-8c73-c389ad785ecb service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859289 Nov 18 18:26:43.630743 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb8d3ad6-0b39-4983-856e-57f69bbfb845 req-b83fe832-1dd6-4035-adb7-b027223f78a7 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:43.632134 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-cb8d3ad6-0b39-4983-856e-57f69bbfb845 req-b83fe832-1dd6-4035-adb7-b027223f78a7 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0510762 Nov 18 18:26:43.679407 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-cb8d3ad6-0b39-4983-856e-57f69bbfb845 req-d55b6ad4-723c-47a0-94a8-73399f17c96a tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410891 Nov 18 18:26:44.791806 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df3f9f08-2230-4fdb-b097-cdbd72ab0d23 req-0e7fd932-ce73-4133-9e33-1949d293d47a tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:44.793293 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-df3f9f08-2230-4fdb-b097-cdbd72ab0d23 req-0e7fd932-ce73-4133-9e33-1949d293d47a tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0474801 Nov 18 18:26:44.840712 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-df3f9f08-2230-4fdb-b097-cdbd72ab0d23 req-a5c21eb4-b3c1-49f7-bc18-5fd39fd69a67 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415957 Nov 18 18:26:45.952410 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55832b86-cd56-4166-b2d1-225d49d4c048 req-75068492-0f29-4a63-9aa5-58c00e53b5dc tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:45.953873 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-55832b86-cd56-4166-b2d1-225d49d4c048 req-75068492-0f29-4a63-9aa5-58c00e53b5dc tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0469518 Nov 18 18:26:46.005555 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-55832b86-cd56-4166-b2d1-225d49d4c048 req-1e600e64-5353-4c68-b87e-9ed70530fea8 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449209 Nov 18 18:26:47.117133 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5d44a2f-605d-42e8-8b12-2d0936dadf4c req-78bc01a5-7286-441b-82cf-d8d5b70eefda tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:47.119218 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c5d44a2f-605d-42e8-8b12-2d0936dadf4c req-78bc01a5-7286-441b-82cf-d8d5b70eefda tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0481169 Nov 18 18:26:47.165760 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c5d44a2f-605d-42e8-8b12-2d0936dadf4c req-ea518a16-c063-421f-bf1e-e464b14c75d5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402274 Nov 18 18:26:48.277363 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e45a9f-c158-4e09-adfa-e87ec68a50d3 req-f049dbbb-acd4-462b-867d-c36664f3f512 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:48.278846 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-90e45a9f-c158-4e09-adfa-e87ec68a50d3 req-f049dbbb-acd4-462b-867d-c36664f3f512 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0476348 Nov 18 18:26:48.327252 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-90e45a9f-c158-4e09-adfa-e87ec68a50d3 req-964fbf71-8c02-4aa6-b705-5b1c80200f81 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420256 Nov 18 18:26:49.441638 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6492a9d-913f-48cf-940b-5f61e661571d req-5d8db89c-210e-4b0f-9046-ae2391ab2496 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:49.443082 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b6492a9d-913f-48cf-940b-5f61e661571d req-5d8db89c-210e-4b0f-9046-ae2391ab2496 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0498405 Nov 18 18:26:49.491936 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b6492a9d-913f-48cf-940b-5f61e661571d req-3488e43e-c0b0-4f09-8d37-0853978d3302 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416491 Nov 18 18:26:50.604149 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d55be9-d952-43a8-b289-b0aa8043cc98 req-f191107d-8e83-4555-bdd5-a4a01109b4be tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:50.605643 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-93d55be9-d952-43a8-b289-b0aa8043cc98 req-f191107d-8e83-4555-bdd5-a4a01109b4be tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0471709 Nov 18 18:26:50.654074 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-93d55be9-d952-43a8-b289-b0aa8043cc98 req-48c5feca-891a-413c-a296-09af130c0b95 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425200 Nov 18 18:26:51.124668 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:51.774002 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-186f7eaf-48ce-4165-9cb5-7329d882fdf1 req-f8bfabfc-c5a5-442e-9335-059b5dadedac tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:51.776125 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-186f7eaf-48ce-4165-9cb5-7329d882fdf1 req-f8bfabfc-c5a5-442e-9335-059b5dadedac tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0512645 Nov 18 18:26:51.825227 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-186f7eaf-48ce-4165-9cb5-7329d882fdf1 req-b79975fa-43b4-44e3-85c2-6c69ef3073f8 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428908 Nov 18 18:26:52.101264 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d74a914-c5f4-41f3-a187-25de6cfb7a0f req-25070b1f-eba0-40ad-96de-ed0f66c1e6ec tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:52.102717 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4d74a914-c5f4-41f3-a187-25de6cfb7a0f req-25070b1f-eba0-40ad-96de-ed0f66c1e6ec tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 945 time: 0.0482419 Nov 18 18:26:52.148530 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4d74a914-c5f4-41f3-a187-25de6cfb7a0f req-a38743ae-306f-4065-b944-549f04c4abed tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400498 Nov 18 18:26:52.939084 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6810f139-a0d8-4ed6-8a67-799533f4f40f req-3fe08d71-3fa9-4c04-80de-546b352d37a1 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:52.940615 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6810f139-a0d8-4ed6-8a67-799533f4f40f req-3fe08d71-3fa9-4c04-80de-546b352d37a1 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0477836 Nov 18 18:26:52.992889 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6810f139-a0d8-4ed6-8a67-799533f4f40f req-38128ec6-5b9b-4f0b-ac75-9c584f9e18a7 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465121 Nov 18 18:26:53.262368 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-067c2070-4ddd-4165-a2af-2555cf0a1cd7 req-80910c7b-250e-4246-a165-6148c90ca3bd tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:53.263841 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-067c2070-4ddd-4165-a2af-2555cf0a1cd7 req-80910c7b-250e-4246-a165-6148c90ca3bd tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 945 time: 0.0470417 Nov 18 18:26:53.310074 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-067c2070-4ddd-4165-a2af-2555cf0a1cd7 req-6a3038f7-2e4f-4a37-bffc-898468dbf3b0 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404959 Nov 18 18:26:54.104615 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3c8225f-b5a1-4db3-a396-fb67abc17c1e req-8d0bdc58-f6b7-4a1c-9a2a-0a02efe95406 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:54.106105 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b3c8225f-b5a1-4db3-a396-fb67abc17c1e req-8d0bdc58-f6b7-4a1c-9a2a-0a02efe95406 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0477033 Nov 18 18:26:54.153610 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b3c8225f-b5a1-4db3-a396-fb67abc17c1e req-60e8609e-5e44-4582-b1cb-cad30ed47843 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416451 Nov 18 18:26:54.396657 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-247d16aa-9037-42c3-9e74-d00e677a1e21 req-a57b1d0f-c0c8-4906-b74f-eee64e138538 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:54.398121 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-247d16aa-9037-42c3-9e74-d00e677a1e21 req-a57b1d0f-c0c8-4906-b74f-eee64e138538 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.31 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 945 time: 0.0481343 Nov 18 18:26:54.429719 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50587b77-56c6-4e0e-80d7-50ca9e975bc3 req-058fc33c-eaae-4e61-8e28-6793176e0979 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:54.431195 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50587b77-56c6-4e0e-80d7-50ca9e975bc3 req-058fc33c-eaae-4e61-8e28-6793176e0979 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/ports?device_id=663561af-f46a-4db6-823e-c06f57aba240 HTTP/1.1" status: 200 len: 945 time: 0.0514972 Nov 18 18:26:54.479546 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50587b77-56c6-4e0e-80d7-50ca9e975bc3 req-4754c009-fc53-42d8-b2d0-7083fef90275 tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.82 "GET /v2.0/security-groups?id=5db6b05a-02c4-413e-92b0-d64c41b76294&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417602 Nov 18 18:26:54.499387 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [req-247d16aa-9037-42c3-9e74-d00e677a1e21 req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Deleting port acf85dcd-458e-4cbf-8320-7c37a3a988a2 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:26:54.499726 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-247d16aa-9037-42c3-9e74-d00e677a1e21 req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:54.584789 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-247d16aa-9037-42c3-9e74-d00e677a1e21 req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] For port acf85dcd-458e-4cbf-8320-7c37a3a988a2, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=acf85dcd-458e-4cbf-8320-7c37a3a988a2,segment=NetworkSegment(6f13a496-1ac6-44ee-a618-9dee39276ca6),segment_id=6f13a496-1ac6-44ee-a618-9dee39276ca6)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:26:54.585152 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-247d16aa-9037-42c3-9e74-d00e677a1e21 req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:54.597395 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [req-247d16aa-9037-42c3-9e74-d00e677a1e21 req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Calling delete_port for acf85dcd-458e-4cbf-8320-7c37a3a988a2 owned by compute:nova {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:26:54.720567 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-247d16aa-9037-42c3-9e74-d00e677a1e21 req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:54.733126 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['acf85dcd-458e-4cbf-8320-7c37a3a988a2'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:26:54.747577 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Pushing event deleted for resources: {'Port': ['ID=acf85dcd-458e-4cbf-8320-7c37a3a988a2,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:26:54.757323 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:54.757679 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:54.758043 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:54.758370 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:54.758707 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:54.759040 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:54.759371 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:54.760194 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:54.760194 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:54.760441 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:54.760742 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:54.761069 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:26:54.799949 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-247d16aa-9037-42c3-9e74-d00e677a1e21 req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] No DVR routers for this DVR port acf85dcd-458e-4cbf-8320-7c37a3a988a2 on host hv-cinder-78776 {{(pid=102688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:26:54.802609 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-247d16aa-9037-42c3-9e74-d00e677a1e21 req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:26:54.806093 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-247d16aa-9037-42c3-9e74-d00e677a1e21 req-1a0c9eb1-b937-4c88-a966-1ae69edab8fb tempest-VolumesSnapshotTestJSON-1972091815 tempest-VolumesSnapshotTestJSON-1972091815-project] 10.222.0.31 "DELETE /v2.0/ports/acf85dcd-458e-4cbf-8320-7c37a3a988a2 HTTP/1.1" status: 204 len: 173 time: 0.3954625 Nov 18 18:26:54.806524 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '663561af-f46a-4db6-823e-c06f57aba240', 'name': 'network-vif-deleted', 'tag': 'acf85dcd-458e-4cbf-8320-7c37a3a988a2'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:26:54.809554 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5f0215c-780f-4a9e-8af0-7564aedfbe70" -d '{"events": [{"server_uuid": "663561af-f46a-4db6-823e-c06f57aba240", "name": "network-vif-deleted", "tag": "acf85dcd-458e-4cbf-8320-7c37a3a988a2"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:26:54.846809 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:26:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-afadd219-cd98-4838-9565-bb74b02e61cf x-openstack-request-id: req-afadd219-cd98-4838-9565-bb74b02e61cf {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:26:54.847175 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "663561af-f46a-4db6-823e-c06f57aba240", "name": "network-vif-deleted", "tag": "acf85dcd-458e-4cbf-8320-7c37a3a988a2", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:26:54.847416 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-afadd219-cd98-4838-9565-bb74b02e61cf {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:26:54.847812 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '663561af-f46a-4db6-823e-c06f57aba240', 'name': 'network-vif-deleted', 'tag': 'acf85dcd-458e-4cbf-8320-7c37a3a988a2', 'status': 'completed', 'code': 200} Nov 18 18:26:55.267994 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6099d0c-e493-4c3b-82e0-13d374838778 req-9772303c-e33a-4e52-b97c-5e5496e99909 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:55.269661 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c6099d0c-e493-4c3b-82e0-13d374838778 req-9772303c-e33a-4e52-b97c-5e5496e99909 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0473206 Nov 18 18:26:55.319240 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c6099d0c-e493-4c3b-82e0-13d374838778 req-331993dd-8044-46eb-a5d2-15194559b1d2 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435870 Nov 18 18:26:55.477529 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:26:56.434160 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d16a97-25a7-4968-965b-dd9d0f0e55bb req-c28da7ee-202d-4da4-8841-a4f4346c64c5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:56.435635 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-73d16a97-25a7-4968-965b-dd9d0f0e55bb req-c28da7ee-202d-4da4-8841-a4f4346c64c5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0477991 Nov 18 18:26:56.487170 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-73d16a97-25a7-4968-965b-dd9d0f0e55bb req-74adb121-537b-40a6-807d-932536a17937 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456285 Nov 18 18:26:56.573401 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5509a67-d697-4b0a-b2b8-076176c3fec2 req-d37113cc-9008-4f45-8d8b-7e9481c289ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:56.574904 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-c5509a67-d697-4b0a-b2b8-076176c3fec2 req-d37113cc-9008-4f45-8d8b-7e9481c289ab service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=029e580af1e3498aa00c86f5ce660a80&device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 1099 time: 0.0429041 Nov 18 18:26:56.670404 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5509a67-d697-4b0a-b2b8-076176c3fec2 req-8f145106-b5e3-4fec-b342-22c2602c5d5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:56.671846 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-c5509a67-d697-4b0a-b2b8-076176c3fec2 req-8f145106-b5e3-4fec-b342-22c2602c5d5e service neutron] 10.222.0.31 "GET /v2.0/networks?id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a HTTP/1.1" status: 200 len: 909 time: 0.0829599 Nov 18 18:26:56.741013 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-c5509a67-d697-4b0a-b2b8-076176c3fec2 req-7ba29139-6bab-4a15-8a7d-7060d050fbf0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f HTTP/1.1" status: 200 len: 1001 time: 0.0601330 Nov 18 18:26:56.792089 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5509a67-d697-4b0a-b2b8-076176c3fec2 req-0be89937-3b0d-4989-8999-d61a5c748a47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:56.793633 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-c5509a67-d697-4b0a-b2b8-076176c3fec2 req-0be89937-3b0d-4989-8999-d61a5c748a47 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cac1be0a-3676-49bd-8292-3623cc0fc8b1 HTTP/1.1" status: 200 len: 846 time: 0.0437789 Nov 18 18:26:56.839910 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5509a67-d697-4b0a-b2b8-076176c3fec2 req-b6659fc8-0c98-45e5-968e-2cc7adcd0aba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:56.841463 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-c5509a67-d697-4b0a-b2b8-076176c3fec2 req-b6659fc8-0c98-45e5-968e-2cc7adcd0aba service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0404127 Nov 18 18:26:56.936110 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-c5509a67-d697-4b0a-b2b8-076176c3fec2 req-97c635ca-9061-4590-902b-878402360868 service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865762 Nov 18 18:26:57.029046 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-c5509a67-d697-4b0a-b2b8-076176c3fec2 req-bf848cd9-40ee-41af-a482-6a8da6aeb5f0 service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848925 Nov 18 18:26:57.597886 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb1b4b2-2123-42d5-bc92-911e57846f00 req-da1b4c79-3b54-4eba-b0aa-4b128d6e70cc tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:57.599356 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3eb1b4b2-2123-42d5-bc92-911e57846f00 req-da1b4c79-3b54-4eba-b0aa-4b128d6e70cc tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0467734 Nov 18 18:26:57.648408 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3eb1b4b2-2123-42d5-bc92-911e57846f00 req-90d7f60e-2dbf-42aa-bc88-171b3fbf59c9 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426033 Nov 18 18:26:58.759128 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91d9f048-98d7-4df8-85c6-038e27db2640 req-0c237cb6-cd7b-4662-a402-9a2d4e48be6c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:58.761180 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-91d9f048-98d7-4df8-85c6-038e27db2640 req-0c237cb6-cd7b-4662-a402-9a2d4e48be6c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0473509 Nov 18 18:26:58.808482 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-91d9f048-98d7-4df8-85c6-038e27db2640 req-9485f5d6-6b75-48e4-a0ff-76d1ef0b94b0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413690 Nov 18 18:26:59.007015 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device acf85dcd-458e-4cbf-8320-7c37a3a988a2 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:26:59.026503 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: acf85dcd-458e-4cbf-8320-7c37a3a988a2 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:26:59.026850 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device acf85dcd-458e-4cbf-8320-7c37a3a988a2 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:26:59.923360 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f57aa8-6b0b-417c-94f6-dbb3c9593c0f req-f1b4a711-657d-4cc0-9206-d3bcdb6be9aa tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:26:59.924864 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18f57aa8-6b0b-417c-94f6-dbb3c9593c0f req-f1b4a711-657d-4cc0-9206-d3bcdb6be9aa tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0505195 Nov 18 18:26:59.972386 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-18f57aa8-6b0b-417c-94f6-dbb3c9593c0f req-bd9a2018-405c-4553-854a-38261e0d63d8 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416901 Nov 18 18:27:01.084553 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426f46f7-741a-4e40-b3f2-1a3ee3258f42 req-c9074695-05c4-4f16-9e5a-3ab1a0a9b8f4 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:01.086068 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-426f46f7-741a-4e40-b3f2-1a3ee3258f42 req-c9074695-05c4-4f16-9e5a-3ab1a0a9b8f4 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0490172 Nov 18 18:27:01.135330 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-426f46f7-741a-4e40-b3f2-1a3ee3258f42 req-79183031-802f-46b9-a556-8b676714f4e1 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426040 Nov 18 18:27:02.254141 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7491629b-0e9e-47f1-b8a3-d3cdc36c8aa3 req-f2fb4434-62de-4a23-9aab-4382be0dafd8 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:02.255627 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7491629b-0e9e-47f1-b8a3-d3cdc36c8aa3 req-f2fb4434-62de-4a23-9aab-4382be0dafd8 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0525384 Nov 18 18:27:02.304597 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7491629b-0e9e-47f1-b8a3-d3cdc36c8aa3 req-3e6f79ab-79dd-4224-b7ca-b0caf781b407 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428755 Nov 18 18:27:02.375775 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [req-56d3ac7d-66d7-4f48-8d6b-c0a4779358a6 req-d5a32968-b0d8-4c86-9b79-00c45f3fa3d9 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:27:02.377026 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-56d3ac7d-66d7-4f48-8d6b-c0a4779358a6 req-d5a32968-b0d8-4c86-9b79-00c45f3fa3d9 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0058208 Nov 18 18:27:02.524894 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43596) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:02.535459 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca2db505-6efd-4ca5-be79-0d48a46142fc req-bc345694-7fd6-4a18-a5cc-2236b6399518 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:02.537226 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ca2db505-6efd-4ca5-be79-0d48a46142fc req-bc345694-7fd6-4a18-a5cc-2236b6399518 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0523512 Nov 18 18:27:02.587219 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ca2db505-6efd-4ca5-be79-0d48a46142fc req-cf482bd0-7d18-4215-8293-5f4e514c6c14 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428362 Nov 18 18:27:02.630548 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-d2d6d62a-fafc-4dc2-b5b9-823687b85600 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1037290 Nov 18 18:27:02.639576 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-1021e489-0aa5-4b04-ae58-699dd3040d77 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102688) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:27:02.640560 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-1021e489-0aa5-4b04-ae58-699dd3040d77 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051231 Nov 18 18:27:03.710634 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51288b05-d275-4543-bf3e-0c62e1368b53 req-cedff094-f7f5-4d9c-8972-0b5a05872cc7 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:03.712180 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-51288b05-d275-4543-bf3e-0c62e1368b53 req-cedff094-f7f5-4d9c-8972-0b5a05872cc7 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0506563 Nov 18 18:27:03.766641 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-51288b05-d275-4543-bf3e-0c62e1368b53 req-0b42731d-9646-4355-b5b9-1f9ab98e9911 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482676 Nov 18 18:27:03.991554 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-c9905160-b9eb-4292-955d-e14bd35d3cff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:04.039675 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-51b6c765-b795-4dcb-93f8-13b8f4e8014e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:04.041097 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-51b6c765-b795-4dcb-93f8-13b8f4e8014e service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd&tenant_id=029e580af1e3498aa00c86f5ce660a80 HTTP/1.1" status: 200 len: 1099 time: 0.0699213 Nov 18 18:27:04.105501 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-8a0c5347-8588-4160-9c45-f35755ed6911 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:04.106947 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-8a0c5347-8588-4160-9c45-f35755ed6911 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=029e580af1e3498aa00c86f5ce660a80&device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 1099 time: 0.0409083 Nov 18 18:27:04.200676 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-a391f48d-4d57-41da-a094-6eee9a589d5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:04.202164 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-a391f48d-4d57-41da-a094-6eee9a589d5d service neutron] 10.222.0.31 "GET /v2.0/networks?id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a HTTP/1.1" status: 200 len: 909 time: 0.0852485 Nov 18 18:27:04.268062 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-7b3a604d-8388-4e7e-9120-f9ebdd9f26e9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f HTTP/1.1" status: 200 len: 1001 time: 0.0560532 Nov 18 18:27:04.319600 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-a883dc61-6ec2-440d-a614-3eb627029312 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:04.321071 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-a883dc61-6ec2-440d-a614-3eb627029312 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cac1be0a-3676-49bd-8292-3623cc0fc8b1 HTTP/1.1" status: 200 len: 846 time: 0.0458486 Nov 18 18:27:04.367298 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-d5f92e46-eb7d-48b3-96e2-b55f51bc9b1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:04.368755 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-d5f92e46-eb7d-48b3-96e2-b55f51bc9b1a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0381663 Nov 18 18:27:04.462807 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-927d8cb1-4b37-4373-8dfd-3b4bbec09da3 service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840538 Nov 18 18:27:04.554712 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-fa854d04-207c-4d07-88bf-ed3c31e4922a req-b284d92a-2caf-40f3-b0bb-da7a5aa01fd9 service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835741 Nov 18 18:27:05.154354 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb3fbda-9410-4001-90df-5c20106fd024 req-bfb8e6a1-fe38-4cd6-86ac-93ddc7a24f7c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:05.155730 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eeb3fbda-9410-4001-90df-5c20106fd024 req-bfb8e6a1-fe38-4cd6-86ac-93ddc7a24f7c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.3225868 Nov 18 18:27:05.167729 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2616e7fa-0acf-449e-a539-29a04a78fa13 req-66ca06fc-6fd4-431f-b324-b2456bf0982c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:05.169126 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2616e7fa-0acf-449e-a539-29a04a78fa13 req-66ca06fc-6fd4-431f-b324-b2456bf0982c tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0638840 Nov 18 18:27:05.241131 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-eeb3fbda-9410-4001-90df-5c20106fd024 req-31c658c5-a44a-47a1-9006-329215dc88a0 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0710747 Nov 18 18:27:05.245664 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2616e7fa-0acf-449e-a539-29a04a78fa13 req-3dfa54a0-bc8d-47d7-b1cf-3583f468fd47 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0701644 Nov 18 18:27:06.370821 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-460bf595-3d65-4c53-9ffc-09cd33ffd782 req-5b1f2c47-1d40-4239-83e5-354b2ada7181 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:06.372277 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-460bf595-3d65-4c53-9ffc-09cd33ffd782 req-5b1f2c47-1d40-4239-83e5-354b2ada7181 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0475073 Nov 18 18:27:06.418640 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-460bf595-3d65-4c53-9ffc-09cd33ffd782 req-f7acee6b-178b-409c-955f-e9faca539ded tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406475 Nov 18 18:27:06.437634 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-04a292e3-90eb-4608-bfdd-387143e364c8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:06.474294 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 85e36ba2-dd4d-47c9-b794-f9104af3235f no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:27:06.522743 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb206fbc-1099-4177-b5e2-d6366801fa5d req-d4ddd502-49f8-4790-9903-f89ff0372c92 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:06.524259 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fb206fbc-1099-4177-b5e2-d6366801fa5d req-d4ddd502-49f8-4790-9903-f89ff0372c92 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0480814 Nov 18 18:27:06.552340 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:06.570767 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fb206fbc-1099-4177-b5e2-d6366801fa5d req-b6b5ba5a-e1b1-4e02-97f0-d3627ba21d6e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400381 Nov 18 18:27:06.576510 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:27:06.578746 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e763cd89-63a1-425a-98d3-b60cf6ccc3b5" -d '{"events": [{"server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "name": "network-vif-unplugged", "status": "completed", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:27:06.591901 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 85e36ba2-dd4d-47c9-b794-f9104af3235f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:06.596124 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:06.641426 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=85e36ba2-dd4d-47c9-b794-f9104af3235f,revision_number=6']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:06.677873 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 18 Nov 2021 18:27:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f1e1edb8-0b62-4729-9c69-0381359e414e x-openstack-request-id: req-f1e1edb8-0b62-4729-9c69-0381359e414e {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:27:06.678175 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "name": "network-vif-unplugged", "status": "completed", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:27:06.678438 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-f1e1edb8-0b62-4729-9c69-0381359e414e {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:27:06.678837 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'code': 200} Nov 18 18:27:07.534894 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af41725c-63ea-431f-b3b7-626bdf7ea461 req-ad6dd7e4-7ac8-469d-af73-8433e8eb7bf7 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:07.536358 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-af41725c-63ea-431f-b3b7-626bdf7ea461 req-ad6dd7e4-7ac8-469d-af73-8433e8eb7bf7 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.0508597 Nov 18 18:27:07.583693 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-af41725c-63ea-431f-b3b7-626bdf7ea461 req-152da7aa-c806-40e3-b5c0-9bc945e7112d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409143 Nov 18 18:27:07.683758 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f858ed4e-6a03-46a0-864b-f49b5d8c5a69 req-e4fc8676-aeec-458a-8ed8-b599b125c6cd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:07.685278 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f858ed4e-6a03-46a0-864b-f49b5d8c5a69 req-e4fc8676-aeec-458a-8ed8-b599b125c6cd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0481911 Nov 18 18:27:07.714900 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:07.733065 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f858ed4e-6a03-46a0-864b-f49b5d8c5a69 req-63de9b20-8e8f-42f1-a110-63d9a7581e1d tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419290 Nov 18 18:27:08.694324 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172446e1-45ae-46d4-897e-b66b852a28a3 req-466a3a4e-808c-43ad-932b-b320a05cdbee tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:08.695794 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-172446e1-45ae-46d4-897e-b66b852a28a3 req-466a3a4e-808c-43ad-932b-b320a05cdbee tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.0468223 Nov 18 18:27:08.747641 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-172446e1-45ae-46d4-897e-b66b852a28a3 req-bf042362-3c71-4876-896b-b9cfa4f36114 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452392 Nov 18 18:27:08.848662 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03b04e4-98f2-4e01-92bd-a096e5e791e2 req-dc2628b7-781d-4440-bfb3-4dd65d01f4ce tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:08.850163 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e03b04e4-98f2-4e01-92bd-a096e5e791e2 req-dc2628b7-781d-4440-bfb3-4dd65d01f4ce tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0478404 Nov 18 18:27:08.897239 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e03b04e4-98f2-4e01-92bd-a096e5e791e2 req-1c6a5c89-2c87-4728-a479-56dd72b688a3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406041 Nov 18 18:27:09.056012 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:09.225430 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c0532486-070a-4795-80e4-2be224ffb8e9 req-2e349a96-cdb4-4eb0-ad2d-0dd134617745 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1849061746&fields=id&tenant_id=46a1cb48de6e4f43a563f40fd92f0bf0 HTTP/1.1" status: 200 len: 267 time: 0.0439677 Nov 18 18:27:09.278987 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0532486-070a-4795-80e4-2be224ffb8e9 req-f6ae5c5b-5120-446f-a8db-67c29c91de19 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:09.280600 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c0532486-070a-4795-80e4-2be224ffb8e9 req-f6ae5c5b-5120-446f-a8db-67c29c91de19 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 985 time: 0.0496035 Nov 18 18:27:09.291911 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-c0532486-070a-4795-80e4-2be224ffb8e9 req-9235adb9-c656-459a-99cf-5ae348798002 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Request body: {'port': {'security_groups': ['dd5cdf9b-ed90-4f2d-90c9-38ebebf71969']}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:09.354996 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-015d0efb-4ebb-4095-9693-bce1f575dfd9 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:09.356953 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-015d0efb-4ebb-4095-9693-bce1f575dfd9 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.31 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.0585840 Nov 18 18:27:09.371669 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-c0532486-070a-4795-80e4-2be224ffb8e9 req-9235adb9-c656-459a-99cf-5ae348798002 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:09.500155 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Deleting port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:27:09.500513 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:09.583294 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-c0532486-070a-4795-80e4-2be224ffb8e9 req-9235adb9-c656-459a-99cf-5ae348798002 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] For port e535328b-e6c3-4630-a314-5bd8ccdaad80, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:09.589213 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] For port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:09.589578 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:09.615074 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-c0532486-070a-4795-80e4-2be224ffb8e9 req-9235adb9-c656-459a-99cf-5ae348798002 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:09.620708 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-c0532486-070a-4795-80e4-2be224ffb8e9 req-9235adb9-c656-459a-99cf-5ae348798002 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:09.646512 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['e535328b-e6c3-4630-a314-5bd8ccdaad80'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:27:09.662737 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0532486-070a-4795-80e4-2be224ffb8e9 req-9235adb9-c656-459a-99cf-5ae348798002 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:09.663375 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-c0532486-070a-4795-80e4-2be224ffb8e9 req-9235adb9-c656-459a-99cf-5ae348798002 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:09.668277 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c0532486-070a-4795-80e4-2be224ffb8e9 req-9235adb9-c656-459a-99cf-5ae348798002 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "PUT /v2.0/ports/e535328b-e6c3-4630-a314-5bd8ccdaad80 HTTP/1.1" status: 200 len: 943 time: 0.3809135 Nov 18 18:27:09.671355 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:27:09.673040 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43682) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:09.673392 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dda26904-94f8-4b20-98ff-3ad2c4251a67" -d '{"events": [{"name": "network-changed", "server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:27:09.703491 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9235adb9-c656-459a-99cf-5ae348798002 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event updated for resources: {'Port': ['ID=e535328b-e6c3-4630-a314-5bd8ccdaad80,revision_number=7']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:09.739311 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:27:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c32121f3-a1e8-4b2c-be77-b435a4b44c71 x-openstack-request-id: req-c32121f3-a1e8-4b2c-be77-b435a4b44c71 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:27:09.739768 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:27:09.740108 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-c32121f3-a1e8-4b2c-be77-b435a4b44c71 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:27:09.740575 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'status': 'completed', 'code': 200} Nov 18 18:27:09.767485 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['e535328b-e6c3-4630-a314-5bd8ccdaad80'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:27:09.828779 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-21b34d7e-2ae9-4f1b-8e0e-51871d87dd35 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:09.840777 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dda26904-94f8-4b20-98ff-3ad2c4251a67 req-1b3a5b21-8064-47e0-94eb-92d0a1586448 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:09.842429 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dda26904-94f8-4b20-98ff-3ad2c4251a67 req-1b3a5b21-8064-47e0-94eb-92d0a1586448 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=46a1cb48de6e4f43a563f40fd92f0bf0&device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 1099 time: 0.0692649 Nov 18 18:27:09.861930 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-21b34d7e-2ae9-4f1b-8e0e-51871d87dd35 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:09.981706 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14959c51-49e3-4255-8eaf-0fc1450be828 req-2293bbc9-646f-4f79-b450-bb8f37d84d85 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:09.990158 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-14959c51-49e3-4255-8eaf-0fc1450be828 req-2293bbc9-646f-4f79-b450-bb8f37d84d85 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.1430624 Nov 18 18:27:09.995608 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:09.996024 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:09.996403 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.l3_db [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Floating IP ac740b22-02e4-4cee-b156-000f4ed202ba disassociated. External IP: 172.27.1.231, port: d5a1ed38-73b7-489f-8676-f9b3ae9bd34f. Nov 18 18:27:09.996750 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Calling delete_port for d5a1ed38-73b7-489f-8676-f9b3ae9bd34f owned by compute:nova {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:27:10.000481 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-5dd5a1a4-9721-42ec-b3da-c8279f7ad788 None None] Provisioning complete for port e535328b-e6c3-4630-a314-5bd8ccdaad80 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:10.000865 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5dd5a1a4-9721-42ec-b3da-c8279f7ad788 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:10.073015 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-21b34d7e-2ae9-4f1b-8e0e-51871d87dd35 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:10.075813 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-21b34d7e-2ae9-4f1b-8e0e-51871d87dd35 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:10.077004 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-21b34d7e-2ae9-4f1b-8e0e-51871d87dd35 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "DELETE /v2.0/security-groups/43932994-97a2-4b28-a8c8-cacaf8d0e5e6 HTTP/1.1" status: 204 len: 168 time: 0.4030423 Nov 18 18:27:10.081484 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43690) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:10.089923 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-14959c51-49e3-4255-8eaf-0fc1450be828 req-cd68ce14-3a63-495c-8444-918cff54fe17 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0988986 Nov 18 18:27:10.104815 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dda26904-94f8-4b20-98ff-3ad2c4251a67 req-e832ffa4-6480-46f1-a9e2-b455b4319fa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:10.106302 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dda26904-94f8-4b20-98ff-3ad2c4251a67 req-e832ffa4-6480-46f1-a9e2-b455b4319fa8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=c5332eb5-c186-4bcf-89d9-eb78be973548 HTTP/1.1" status: 200 len: 917 time: 0.2478790 Nov 18 18:27:10.130845 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1368d846-db43-4dce-b882-9545596a2302 req-803185a5-0bd6-4089-ae4e-9eb6e3084827 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:10.132447 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1368d846-db43-4dce-b882-9545596a2302 req-803185a5-0bd6-4089-ae4e-9eb6e3084827 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 945 time: 0.1090493 Nov 18 18:27:10.137788 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21b34d7e-2ae9-4f1b-8e0e-51871d87dd35 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=43932994-97a2-4b28-a8c8-cacaf8d0e5e6,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:10.209363 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dda26904-94f8-4b20-98ff-3ad2c4251a67 req-71395e06-3f0e-4437-bf41-fb45498c59e4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80 HTTP/1.1" status: 200 len: 1002 time: 0.0941343 Nov 18 18:27:10.214124 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:10.229964 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1368d846-db43-4dce-b882-9545596a2302 req-0f17aef4-fb92-4ce7-964e-4043677286e8 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=fa2c021a-c84e-4618-bb5b-faf8330f97f4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0696459 Nov 18 18:27:10.272865 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dda26904-94f8-4b20-98ff-3ad2c4251a67 req-97aa6291-e299-4f78-b053-8bbe93716955 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:10.273563 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:10.274347 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dda26904-94f8-4b20-98ff-3ad2c4251a67 req-97aa6291-e299-4f78-b053-8bbe93716955 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24097eeb-7eeb-4617-b83d-a363de5de9b1 HTTP/1.1" status: 200 len: 854 time: 0.0554914 Nov 18 18:27:10.304299 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event deleted for resources: {'Port': ['ID=d5a1ed38-73b7-489f-8676-f9b3ae9bd34f,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:10.328263 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dda26904-94f8-4b20-98ff-3ad2c4251a67 req-7cc4a6b6-f3e3-448d-acd6-73700018b576 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:10.329885 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dda26904-94f8-4b20-98ff-3ad2c4251a67 req-7cc4a6b6-f3e3-448d-acd6-73700018b576 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c5332eb5-c186-4bcf-89d9-eb78be973548&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0437183 Nov 18 18:27:10.360070 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Deleting port 78969e89-e9b9-4bca-8f8e-f9a6aa750ff2 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:27:10.360690 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:10.425606 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dda26904-94f8-4b20-98ff-3ad2c4251a67 req-1622f45d-e729-4a0a-8a65-085307cd4e57 service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0871806 Nov 18 18:27:10.538564 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dda26904-94f8-4b20-98ff-3ad2c4251a67 req-11fa76c0-dbec-4cf2-8084-e7240fd8ec91 service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1005878 Nov 18 18:27:10.694184 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:10.694510 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:10.711889 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Router 9674107a-752c-42c3-a133-60c85d951af8 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102688) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:27:10.712827 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Calling delete_port for 78969e89-e9b9-4bca-8f8e-f9a6aa750ff2 owned by network:floatingip {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:27:10.926992 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:27:10.940560 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff59feb9-bce3-41ff-bb4c-3d9c5f0f19ab None None] Sync routers for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:27:10.950461 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff59feb9-bce3-41ff-bb4c-3d9c5f0f19ab None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:10.951153 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-ff59feb9-bce3-41ff-bb4c-3d9c5f0f19ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:10.977924 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] No DVR routers for this DVR port d5a1ed38-73b7-489f-8676-f9b3ae9bd34f on host hv-cinder-78776 {{(pid=102688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:27:10.996538 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:10.999989 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-d941f066-72bf-40ab-9aa4-ed43260d6163 req-2ef67a0b-73da-467a-bf9e-460a36161a00 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.31 "DELETE /v2.0/ports/d5a1ed38-73b7-489f-8676-f9b3ae9bd34f HTTP/1.1" status: 204 len: 173 time: 1.6348343 Nov 18 18:27:11.001038 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'name': 'network-vif-deleted', 'tag': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:27:11.003407 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-559c92f0-292a-405d-8bf9-a0749ba77121" -d '{"events": [{"server_uuid": "f928d38b-4f6c-47f6-a2e4-70767777e67e", "name": "network-vif-deleted", "tag": "d5a1ed38-73b7-489f-8676-f9b3ae9bd34f"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:27:11.045186 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:11.060857 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5611a245-5a46-48b8-962c-45f18856d740 req-84eeeeab-5856-4d5f-a44a-9b6c6d3c4006 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:11.063095 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5611a245-5a46-48b8-962c-45f18856d740 req-84eeeeab-5856-4d5f-a44a-9b6c6d3c4006 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 1097 time: 0.0621505 Nov 18 18:27:11.072431 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-ff59feb9-bce3-41ff-bb4c-3d9c5f0f19ab None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:11.082591 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:27:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7af3626-4990-4c0e-8520-188966f02623 x-openstack-request-id: req-f7af3626-4990-4c0e-8520-188966f02623 {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:27:11.082943 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f928d38b-4f6c-47f6-a2e4-70767777e67e", "name": "network-vif-deleted", "tag": "d5a1ed38-73b7-489f-8676-f9b3ae9bd34f", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:27:11.083208 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-f7af3626-4990-4c0e-8520-188966f02623 {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:27:11.083736 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f928d38b-4f6c-47f6-a2e4-70767777e67e', 'name': 'network-vif-deleted', 'tag': 'd5a1ed38-73b7-489f-8676-f9b3ae9bd34f', 'status': 'completed', 'code': 200} Nov 18 18:27:11.084618 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event deleted for resources: {'Port': ['ID=78969e89-e9b9-4bca-8f8e-f9a6aa750ff2,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:11.138747 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5611a245-5a46-48b8-962c-45f18856d740 req-0736a766-20b2-41c4-88d9-d70665a46acb service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0588183 Nov 18 18:27:11.173501 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks [] for floatingip, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:11.173954 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.l3_db [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Floating IP 82bfb0bb-ed3d-4d27-bc0c-e435f8e3dda2 disassociated (deleted). External IP: 172.27.1.117, port: e535328b-e6c3-4630-a314-5bd8ccdaad80. Nov 18 18:27:11.238296 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-050605b9-ba77-4fee-bb48-d93db00b9538 req-51c7e6f9-2925-4ca0-aa23-a100f85adc4e tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:11.239855 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-050605b9-ba77-4fee-bb48-d93db00b9538 req-51c7e6f9-2925-4ca0-aa23-a100f85adc4e tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.0576861 Nov 18 18:27:11.300953 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-050605b9-ba77-4fee-bb48-d93db00b9538 req-1a3053ab-53ae-4879-aba2-6308080be77e tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517316 Nov 18 18:27:11.316302 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-ff59feb9-bce3-41ff-bb4c-3d9c5f0f19ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:38Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:11.347298 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff59feb9-bce3-41ff-bb4c-3d9c5f0f19ab None None] Checking router: 9674107a-752c-42c3-a133-60c85d951af8 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:27:11.350466 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-395aa441-d2bb-4019-978a-dc65662b8514 req-fe577fc5-b3d1-4b58-8060-636b69a5f4fd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=f928d38b-4f6c-47f6-a2e4-70767777e67e HTTP/1.1" status: 200 len: 210 time: 0.0271001 Nov 18 18:27:11.356538 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff59feb9-bce3-41ff-bb4c-3d9c5f0f19ab None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:11.357157 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-ff59feb9-bce3-41ff-bb4c-3d9c5f0f19ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:11.412415 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Router e8464c87-c9dc-43f0-9906-eda0c4a24cdb has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102688) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:27:11.524755 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:27:11.529655 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:11.536005 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e85fb634-0282-4d1a-b1d5-263997f98bcf None None] Sync routers for ids ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:27:11.546567 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e85fb634-0282-4d1a-b1d5-263997f98bcf None None] Routers {'e8464c87-c9dc-43f0-9906-eda0c4a24cdb'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:11.547182 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-e85fb634-0282-4d1a-b1d5-263997f98bcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:11.562778 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-995c2854-cff8-4419-abcb-f2269b8e83a9 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "DELETE /v2.0/floatingips/82bfb0bb-ed3d-4d27-bc0c-e435f8e3dda2 HTTP/1.1" status: 204 len: 168 time: 1.4753160 Nov 18 18:27:11.591419 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-ff59feb9-bce3-41ff-bb4c-3d9c5f0f19ab None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:11.653687 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-e85fb634-0282-4d1a-b1d5-263997f98bcf None None] Set router e8464c87-c9dc-43f0-9906-eda0c4a24cdb gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:11.903786 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-ff59feb9-bce3-41ff-bb4c-3d9c5f0f19ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:38Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:11.926593 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-e85fb634-0282-4d1a-b1d5-263997f98bcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:33Z', 'revision_number': 4, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '6401bf2f-1763-4e1c-9200-1fa1bff41750', 'name': '', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'mac_address': 'fa:16:3e:e5:54:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_interface', 'standard_attr_id': 354, 'fixed_ips': [{'subnet_id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:31Z', 'updated_at': '2021-11-18T18:23:38Z', 'revision_number': 5, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'subnets': [{'id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:11.935704 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff59feb9-bce3-41ff-bb4c-3d9c5f0f19ab None None] The sync data for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi is: [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:38Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:27:11.953821 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e85fb634-0282-4d1a-b1d5-263997f98bcf None None] Checking router: e8464c87-c9dc-43f0-9906-eda0c4a24cdb for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:27:11.964113 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e85fb634-0282-4d1a-b1d5-263997f98bcf None None] Routers {'e8464c87-c9dc-43f0-9906-eda0c4a24cdb'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:11.964722 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-e85fb634-0282-4d1a-b1d5-263997f98bcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:12.075035 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-e85fb634-0282-4d1a-b1d5-263997f98bcf None None] Set router e8464c87-c9dc-43f0-9906-eda0c4a24cdb gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:12.163208 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2e87a8a-f23f-4ad9-b1df-c02495b230ee None None] New status for floating IP ac740b22-02e4-4cee-b156-000f4ed202ba: DOWN {{(pid=102690) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:27:12.268522 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 85e36ba2-dd4d-47c9-b794-f9104af3235f details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:27:12.277890 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-e85fb634-0282-4d1a-b1d5-263997f98bcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:33Z', 'revision_number': 4, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '6401bf2f-1763-4e1c-9200-1fa1bff41750', 'name': '', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'mac_address': 'fa:16:3e:e5:54:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_interface', 'standard_attr_id': 354, 'fixed_ips': [{'subnet_id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:31Z', 'updated_at': '2021-11-18T18:23:38Z', 'revision_number': 5, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'subnets': [{'id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:12.331307 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e85fb634-0282-4d1a-b1d5-263997f98bcf None None] The sync data for ids ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'] in dv-cinder-787764-6-iscsi is: [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:33Z', 'revision_number': 4, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '6401bf2f-1763-4e1c-9200-1fa1bff41750', 'name': '', 'network_id': 'c5332eb5-c186-4bcf-89d9-eb78be973548', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'mac_address': 'fa:16:3e:e5:54:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_interface', 'standard_attr_id': 354, 'fixed_ips': [{'subnet_id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:31Z', 'updated_at': '2021-11-18T18:23:38Z', 'revision_number': 5, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'subnets': [{'id': '24097eeb-7eeb-4617-b83d-a363de5de9b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:27:12.432824 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 85e36ba2-dd4d-47c9-b794-f9104af3235f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:12.448858 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'port_id': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'mac_address': 'fa:16:3e:8d:d3:4a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1345, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:27:12.462982 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43734) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:12.486719 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57f5178d-8845-4447-874e-7803b9d1533f req-e4705f28-0718-43e7-8e14-e63041b264f2 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:12.488302 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-57f5178d-8845-4447-874e-7803b9d1533f req-e4705f28-0718-43e7-8e14-e63041b264f2 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 944 time: 0.0756037 Nov 18 18:27:12.496185 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:12.512575 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 85e36ba2-dd4d-47c9-b794-f9104af3235f {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:27:12.536737 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 85e36ba2-dd4d-47c9-b794-f9104af3235f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:12.537722 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-de885007-c67f-4910-ae92-f6b9ce8a48b6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:12.545138 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:12.557755 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-57f5178d-8845-4447-874e-7803b9d1533f req-473b6534-d712-47ba-bd05-5587bd2baf70 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0575383 Nov 18 18:27:12.565774 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-de885007-c67f-4910-ae92-f6b9ce8a48b6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:12.597277 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=85e36ba2-dd4d-47c9-b794-f9104af3235f,revision_number=7']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:12.605542 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:12.606166 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:12.606678 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:12.607004 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:12.607544 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:12.608076 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:12.608437 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:12.608765 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:12.609100 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:12.609425 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:12.609747 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:12.610066 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:12.625053 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-de885007-c67f-4910-ae92-f6b9ce8a48b6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:12.627687 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-de885007-c67f-4910-ae92-f6b9ce8a48b6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:12.628873 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-de885007-c67f-4910-ae92-f6b9ce8a48b6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "DELETE /v2.0/security-groups/fa2c021a-c84e-4618-bb5b-faf8330f97f4 HTTP/1.1" status: 204 len: 168 time: 0.1643267 Nov 18 18:27:12.631667 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43736) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:12.645712 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.api.v2.resource [None req-aeaadc6c-f135-47ef-b6d4-1e559f81afff tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] show failed (client error): The resource could not be found. Nov 18 18:27:12.646765 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-aeaadc6c-f135-47ef-b6d4-1e559f81afff tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups/fa2c021a-c84e-4618-bb5b-faf8330f97f4 HTTP/1.1" status: 404 len: 347 time: 0.0140562 Nov 18 18:27:12.649661 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43738) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:12.650634 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de885007-c67f-4910-ae92-f6b9ce8a48b6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa2c021a-c84e-4618-bb5b-faf8330f97f4,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:12.746049 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63ca0832-273c-4d79-a1ab-5af7aed10cca None None] New status for floating IP 82bfb0bb-ed3d-4d27-bc0c-e435f8e3dda2: DOWN {{(pid=102691) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:27:12.807494 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-02a71a1c-b653-4d1f-9ec1-0941942d775f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Deleting port c21d6cf2-57fc-4203-93f1-43a539d67067 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:27:12.808052 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-02a71a1c-b653-4d1f-9ec1-0941942d775f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:12.870259 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['85e36ba2-dd4d-47c9-b794-f9104af3235f'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:27:12.888493 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-02a71a1c-b653-4d1f-9ec1-0941942d775f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:12.888819 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-02a71a1c-b653-4d1f-9ec1-0941942d775f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:12.902133 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-02a71a1c-b653-4d1f-9ec1-0941942d775f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Calling delete_port for c21d6cf2-57fc-4203-93f1-43a539d67067 owned by network:floatingip {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:27:13.066765 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-02a71a1c-b653-4d1f-9ec1-0941942d775f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.084482 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:27:13.087105 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea8fbdff-ae6e-4489-8968-e6e4cf5cd75c" -d '{"events": [{"name": "network-changed", "server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:27:13.094131 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02a71a1c-b653-4d1f-9ec1-0941942d775f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event deleted for resources: {'Port': ['ID=c21d6cf2-57fc-4203-93f1-43a539d67067,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:13.133597 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:27:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25aae6ad-b350-4935-b285-3dd129750488 x-openstack-request-id: req-25aae6ad-b350-4935-b285-3dd129750488 {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:27:13.133940 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:27:13.136087 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-25aae6ad-b350-4935-b285-3dd129750488 {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:27:13.136756 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'status': 'completed', 'code': 200} Nov 18 18:27:13.167039 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-02a71a1c-b653-4d1f-9ec1-0941942d775f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.170132 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-02a71a1c-b653-4d1f-9ec1-0941942d775f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.171348 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-02a71a1c-b653-4d1f-9ec1-0941942d775f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "DELETE /v2.0/floatingips/ac740b22-02e4-4cee-b156-000f4ed202ba HTTP/1.1" status: 204 len: 168 time: 0.5207751 Nov 18 18:27:13.215339 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea8fbdff-ae6e-4489-8968-e6e4cf5cd75c req-b53d9a0f-67d7-4345-99b2-b14bc5480842 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:13.217093 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ea8fbdff-ae6e-4489-8968-e6e4cf5cd75c req-b53d9a0f-67d7-4345-99b2-b14bc5480842 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=46a1cb48de6e4f43a563f40fd92f0bf0&device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 1099 time: 0.0444391 Nov 18 18:27:13.327450 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea8fbdff-ae6e-4489-8968-e6e4cf5cd75c req-920cbd39-f1e8-437b-9355-eb6516da1c2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:13.329060 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ea8fbdff-ae6e-4489-8968-e6e4cf5cd75c req-920cbd39-f1e8-437b-9355-eb6516da1c2b service neutron] 10.222.0.31 "GET /v2.0/networks?id=c5332eb5-c186-4bcf-89d9-eb78be973548 HTTP/1.1" status: 200 len: 917 time: 0.1029589 Nov 18 18:27:13.378816 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ea8fbdff-ae6e-4489-8968-e6e4cf5cd75c req-05858c7f-3bb0-4fed-a05f-a1b11b859bdf service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80 HTTP/1.1" status: 200 len: 217 time: 0.0379283 Nov 18 18:27:13.430900 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea8fbdff-ae6e-4489-8968-e6e4cf5cd75c req-15f034fc-1a04-48ee-904f-d0384953706a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:13.433645 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ea8fbdff-ae6e-4489-8968-e6e4cf5cd75c req-15f034fc-1a04-48ee-904f-d0384953706a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24097eeb-7eeb-4617-b83d-a363de5de9b1 HTTP/1.1" status: 200 len: 854 time: 0.0467436 Nov 18 18:27:13.449372 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43762) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:13.454058 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-1bd2c4fd-d1f9-41e0-9d78-65566933c3c6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Request body: {'security_group': {'name': 'tempest-securitygroup--490205028', 'description': 'tempest-description--1242729102'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:13.476979 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1bd2c4fd-d1f9-41e0-9d78-65566933c3c6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.482889 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea8fbdff-ae6e-4489-8968-e6e4cf5cd75c req-9d7d293e-581a-427e-8f7f-523aa4f951a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:13.484428 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ea8fbdff-ae6e-4489-8968-e6e4cf5cd75c req-9d7d293e-581a-427e-8f7f-523aa4f951a1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c5332eb5-c186-4bcf-89d9-eb78be973548&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0416405 Nov 18 18:27:13.543043 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1bd2c4fd-d1f9-41e0-9d78-65566933c3c6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.547367 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1bd2c4fd-d1f9-41e0-9d78-65566933c3c6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.577709 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bd2c4fd-d1f9-41e0-9d78-65566933c3c6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event updated for resources: {'SecurityGroup': ['ID=85be819a-494b-4bb1-8456-793f13c276c5,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:13.584788 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1bd2c4fd-d1f9-41e0-9d78-65566933c3c6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.585964 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-1bd2c4fd-d1f9-41e0-9d78-65566933c3c6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1356006 Nov 18 18:27:13.589416 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ea8fbdff-ae6e-4489-8968-e6e4cf5cd75c req-ce6b64b2-c6f5-4d53-83d3-62364ac4c476 service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887530 Nov 18 18:27:13.590164 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43766) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:13.594984 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-68bacd87-734d-4bab-b302-a300742a60a6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Request body: {'security_group_rule': {'security_group_id': '85be819a-494b-4bb1-8456-793f13c276c5', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:13.625930 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-68bacd87-734d-4bab-b302-a300742a60a6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.685088 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-68bacd87-734d-4bab-b302-a300742a60a6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.689035 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-68bacd87-734d-4bab-b302-a300742a60a6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.713664 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68bacd87-734d-4bab-b302-a300742a60a6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4963d7c6-8019-432a-b432-84de80d995d5,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:13.717458 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ea8fbdff-ae6e-4489-8968-e6e4cf5cd75c req-f9091e90-af9e-4d71-a67c-33dd68aba838 service neutron] 10.222.0.31 "GET /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1196439 Nov 18 18:27:13.723659 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-68bacd87-734d-4bab-b302-a300742a60a6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.727484 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-68bacd87-734d-4bab-b302-a300742a60a6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1339843 Nov 18 18:27:13.728296 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43768) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:13.730223 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06661f1c-c19b-4a7b-9e00-04a6eb805e57 req-648fc7a6-316b-4e4f-8be5-28da68d181bb tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:13.731719 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-06661f1c-c19b-4a7b-9e00-04a6eb805e57 req-648fc7a6-316b-4e4f-8be5-28da68d181bb tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 945 time: 0.0757926 Nov 18 18:27:13.732882 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-5ad6c9da-7b56-48f5-879b-1beb8c078e08 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Request body: {'security_group_rule': {'security_group_id': '85be819a-494b-4bb1-8456-793f13c276c5', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:13.761571 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5ad6c9da-7b56-48f5-879b-1beb8c078e08 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.784644 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-06661f1c-c19b-4a7b-9e00-04a6eb805e57 req-7c5bef9a-168a-43af-8626-688982799cdb tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466981 Nov 18 18:27:13.817198 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5ad6c9da-7b56-48f5-879b-1beb8c078e08 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.820536 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5ad6c9da-7b56-48f5-879b-1beb8c078e08 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.838560 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ad6c9da-7b56-48f5-879b-1beb8c078e08 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7a471ae3-560c-40d6-aa55-ba64b687d6e1,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:13.848423 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5ad6c9da-7b56-48f5-879b-1beb8c078e08 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.849684 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-5ad6c9da-7b56-48f5-879b-1beb8c078e08 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1203043 Nov 18 18:27:13.852890 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43774) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:13.857360 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Request body: {'floatingip': {'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:13.879464 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:13.972407 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:14.077037 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Allocated IP 172.27.1.83 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/38277be6-23cb-47a3-afcd-fbc96dd1ce1b) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:27:14.178739 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:14.217576 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:14.255715 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:27:14.258598 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:14.262103 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:27:14.270092 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event updated for resources: {'Port': ['ID=38277be6-23cb-47a3-afcd-fbc96dd1ce1b,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:14.292830 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 85e36ba2-dd4d-47c9-b794-f9104af3235f up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:14.351215 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 85e36ba2-dd4d-47c9-b794-f9104af3235f triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:14.351902 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:14.361584 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:14.400383 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:14.429895 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:14.456734 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:27:14.459077 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f9a24ee-085e-484a-88c1-f21b53858a9a" -d '{"events": [{"server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "name": "network-vif-plugged", "status": "completed", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:27:14.480719 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 85e36ba2-dd4d-47c9-b794-f9104af3235f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:14.486282 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:14.487433 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device d5a1ed38-73b7-489f-8676-f9b3ae9bd34f no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:27:14.507428 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5aeec91-70b8-4d29-b2be-6d43192edca1 req-0a165992-e544-4fe2-b8ea-2029ff77f632 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:14.513947 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d5aeec91-70b8-4d29-b2be-6d43192edca1 req-0a165992-e544-4fe2-b8ea-2029ff77f632 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 946 time: 0.1103127 Nov 18 18:27:14.526975 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:27:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2410b2e0-86ad-4640-83c1-133503135410 x-openstack-request-id: req-2410b2e0-86ad-4640-83c1-133503135410 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:27:14.527274 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "name": "network-vif-plugged", "status": "completed", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:27:14.527532 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-2410b2e0-86ad-4640-83c1-133503135410 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:27:14.527934 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'code': 200} Nov 18 18:27:14.528605 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: d5a1ed38-73b7-489f-8676-f9b3ae9bd34f {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:27:14.528951 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device d5a1ed38-73b7-489f-8676-f9b3ae9bd34f not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:27:14.556034 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=85e36ba2-dd4d-47c9-b794-f9104af3235f,revision_number=8']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:14.611302 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d5aeec91-70b8-4d29-b2be-6d43192edca1 req-aad62a74-15dd-4bf1-a65a-775325bb41d6 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0945320 Nov 18 18:27:14.637303 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:14.641899 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:14.706804 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event updated for resources: {'Port': ['ID=38277be6-23cb-47a3-afcd-fbc96dd1ce1b,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:14.718956 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:14.734451 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:14.735809 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-0782f34b-d2e9-42cb-87a1-cafeae0061a2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 0.8819108 Nov 18 18:27:14.881140 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-aa89ddaa-75dd-4ee4-9852-7fbf0c6863b7 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--490205028&fields=id&tenant_id=1bab99f3344342578dc7b1c29b1ced7e HTTP/1.1" status: 200 len: 267 time: 0.0442271 Nov 18 18:27:14.984163 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-b7593888-9048-4831-b95e-08afd986e606 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:14.985623 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-b7593888-9048-4831-b95e-08afd986e606 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/networks?id=f2a08e65-1c6c-43fe-a019-78643e62bd9f HTTP/1.1" status: 200 len: 810 time: 0.0975342 Nov 18 18:27:14.999610 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-edf2c4c4-bb05-4517-81f6-7eb26fd4896b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/quotas/1bab99f3344342578dc7b1c29b1ced7e HTTP/1.1" status: 200 len: 375 time: 0.0085933 Nov 18 18:27:15.048716 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-3ad5e336-0651-480d-9782-5fe34fe7ca96 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=1bab99f3344342578dc7b1c29b1ced7e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0441613 Nov 18 18:27:15.144378 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-a8458607-9b60-487d-8838-a09be5a3edfc service neutron] 10.222.0.82 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839674 Nov 18 18:27:15.231783 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-e6a76f4a-57b7-4909-9c0f-712ab91d3363 service neutron] 10.222.0.82 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815437 Nov 18 18:27:15.392873 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c5373417-7d00-4232-bace-7bf784665a7a req-bd2964ba-d9c1-4a17-a15e-854303cf6100 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 210 time: 0.0299227 Nov 18 18:27:15.730519 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e430056-8461-45b6-835c-ae8dab9252e1 req-5d90538a-fc03-4e82-b1bb-6f8773b26530 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:15.732090 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2e430056-8461-45b6-835c-ae8dab9252e1 req-5d90538a-fc03-4e82-b1bb-6f8773b26530 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 946 time: 0.0540860 Nov 18 18:27:15.779556 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2e430056-8461-45b6-835c-ae8dab9252e1 req-718d88a9-374d-477b-b3b8-9fe3d2b2952f tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414152 Nov 18 18:27:16.384891 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-8a4d630a-6280-49e2-9dab-7c40a3c52ffb tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:16.386416 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-8a4d630a-6280-49e2-9dab-7c40a3c52ffb tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.31 "GET /v2.0/networks?id=f2a08e65-1c6c-43fe-a019-78643e62bd9f HTTP/1.1" status: 200 len: 810 time: 0.1137180 Nov 18 18:27:16.457748 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-d5c2d481-cbf3-4318-81e0-a332946bff5b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1bab99f3344342578dc7b1c29b1ced7e HTTP/1.1" status: 200 len: 379 time: 0.0606887 Nov 18 18:27:16.477275 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Request body: {'port': {'device_id': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'admin_state_up': True, 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'security_groups': ['85be819a-494b-4bb1-8456-793f13c276c5']}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:16.518911 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a14773d-55cb-48d3-838d-84ac786150cf req-c9703b9a-5d87-4598-afb6-496df4bfc595 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:16.520459 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-4a14773d-55cb-48d3-838d-84ac786150cf req-c9703b9a-5d87-4598-afb6-496df4bfc595 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.31 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 946 time: 0.0529037 Nov 18 18:27:16.520708 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-936d0958-6c3d-496c-8f24-818016a93f2e req-4a12091a-37c2-43e8-8a0b-849c228c7f15 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 210 time: 0.0475247 Nov 18 18:27:16.619207 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Made reservation on behalf of 1bab99f3344342578dc7b1c29b1ced7e for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:27:16.623200 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:16.628470 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [req-4a14773d-55cb-48d3-838d-84ac786150cf req-fef2df75-15bf-459d-ac8d-6f85f6721684 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Deleting port e535328b-e6c3-4630-a314-5bd8ccdaad80 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:27:16.628813 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-4a14773d-55cb-48d3-838d-84ac786150cf req-fef2df75-15bf-459d-ac8d-6f85f6721684 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:16.720064 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [req-4a14773d-55cb-48d3-838d-84ac786150cf req-fef2df75-15bf-459d-ac8d-6f85f6721684 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] For port e535328b-e6c3-4630-a314-5bd8ccdaad80, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=e535328b-e6c3-4630-a314-5bd8ccdaad80,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:16.720446 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-4a14773d-55cb-48d3-838d-84ac786150cf req-fef2df75-15bf-459d-ac8d-6f85f6721684 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:16.737631 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [req-4a14773d-55cb-48d3-838d-84ac786150cf req-fef2df75-15bf-459d-ac8d-6f85f6721684 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Calling delete_port for e535328b-e6c3-4630-a314-5bd8ccdaad80 owned by compute:nova {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:27:16.753301 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Allocated IP 172.20.0.4 (f2a08e65-1c6c-43fe-a019-78643e62bd9f/53535ce7-7c2a-450f-87e4-d092908ff080/ffe1f693-e5ac-4652-9079-c7b4eebd4317) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:27:16.868168 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-4a14773d-55cb-48d3-838d-84ac786150cf req-fef2df75-15bf-459d-ac8d-6f85f6721684 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:16.880202 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['e535328b-e6c3-4630-a314-5bd8ccdaad80'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:27:16.896894 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b0377018-e44a-4b8b-956b-44a6fcc765ac req-31e18bbf-8b62-45c8-a8e1-16994318cb31 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.82 "GET /v2.0/ports?device_id=ac8365fc-2da5-48db-bbb8-03b08cb05d54 HTTP/1.1" status: 200 len: 210 time: 0.0318084 Nov 18 18:27:16.906116 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fef2df75-15bf-459d-ac8d-6f85f6721684 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Pushing event deleted for resources: {'Port': ['ID=e535328b-e6c3-4630-a314-5bd8ccdaad80,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:16.938688 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:16.952645 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [req-4a14773d-55cb-48d3-838d-84ac786150cf req-fef2df75-15bf-459d-ac8d-6f85f6721684 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] No DVR routers for this DVR port e535328b-e6c3-4630-a314-5bd8ccdaad80 on host hv-cinder-78776 {{(pid=102688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:27:16.955154 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [req-4a14773d-55cb-48d3-838d-84ac786150cf req-fef2df75-15bf-459d-ac8d-6f85f6721684 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:16.958564 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [req-4a14773d-55cb-48d3-838d-84ac786150cf req-fef2df75-15bf-459d-ac8d-6f85f6721684 tempest-TestMinimumBasicScenario-1636774177 tempest-TestMinimumBasicScenario-1636774177-project] 10.222.0.31 "DELETE /v2.0/ports/e535328b-e6c3-4630-a314-5bd8ccdaad80 HTTP/1.1" status: 204 len: 173 time: 0.4219072 Nov 18 18:27:16.959007 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'name': 'network-vif-deleted', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80'}] {{(pid=102688) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:27:16.961247 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f9f232f98f34dab2b21eef9cbb67a7de9a02ae4990850eb19d7715f931a737ae" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-97638d23-a498-45a4-8a1e-93b1206b87f5" -d '{"events": [{"server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "name": "network-vif-deleted", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80"}]}' {{(pid=102688) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:27:16.975123 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:16.997472 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:27:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3c03f18f-0edc-441b-be09-b160e4d507eb x-openstack-request-id: req-3c03f18f-0edc-441b-be09-b160e4d507eb {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:27:16.997775 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ac8365fc-2da5-48db-bbb8-03b08cb05d54", "name": "network-vif-deleted", "tag": "e535328b-e6c3-4630-a314-5bd8ccdaad80", "status": "completed", "code": 200}]} {{(pid=102688) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:27:16.998034 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-3c03f18f-0edc-441b-be09-b160e4d507eb {{(pid=102688) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:27:16.998440 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ac8365fc-2da5-48db-bbb8-03b08cb05d54', 'name': 'network-vif-deleted', 'tag': 'e535328b-e6c3-4630-a314-5bd8ccdaad80', 'status': 'completed', 'code': 200} Nov 18 18:27:17.027392 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Network f2a08e65-1c6c-43fe-a019-78643e62bd9f is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:27:17.030523 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:17.032873 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:27:17.067245 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event updated for resources: {'Port': ['ID=ffe1f693-e5ac-4652-9079-c7b4eebd4317,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:17.099039 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:17.099685 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:17.119256 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-816dbb28-e381-4ade-93cd-ebae03df0178 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6479218 Nov 18 18:27:17.133825 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Request body: {'port': {'device_id': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:17.191301 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:17.265975 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-5b534126-b902-4091-8e76-4dec34fe5dfa None None] Provisioning complete for port ffe1f693-e5ac-4652-9079-c7b4eebd4317 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:17.266472 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5b534126-b902-4091-8e76-4dec34fe5dfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:17.305380 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-5b534126-b902-4091-8e76-4dec34fe5dfa None None] Port ffe1f693-e5ac-4652-9079-c7b4eebd4317 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:27:17.734334 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827597ff-f57f-48c0-96dc-11574c5a55bc req-6dda9d36-72c1-4322-a4d8-6ddeade9a820 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:17.735817 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-827597ff-f57f-48c0-96dc-11574c5a55bc req-6dda9d36-72c1-4322-a4d8-6ddeade9a820 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 931 time: 0.0931835 Nov 18 18:27:17.741702 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ffe1f693-e5ac-4652-9079-c7b4eebd4317 {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:27:17.754883 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:17.783325 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Transition to ACTIVE for port object ffe1f693-e5ac-4652-9079-c7b4eebd4317 will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:27:17.789268 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:17.834568 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-827597ff-f57f-48c0-96dc-11574c5a55bc req-9c0f6457-4ea1-4b8b-bfa9-7e8732470c53 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=85be819a-494b-4bb1-8456-793f13c276c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0879793 Nov 18 18:27:17.858368 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Pushing event updated for resources: {'Port': ['ID=ffe1f693-e5ac-4652-9079-c7b4eebd4317,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:17.930741 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Attempting to bind port ffe1f693-e5ac-4652-9079-c7b4eebd4317 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:27:17.931163 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Attempting to bind port ffe1f693-e5ac-4652-9079-c7b4eebd4317 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:27:17.931499 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Attempting to bind port ffe1f693-e5ac-4652-9079-c7b4eebd4317 on network f2a08e65-1c6c-43fe-a019-78643e62bd9f {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:27:17.936870 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Port ffe1f693-e5ac-4652-9079-c7b4eebd4317 on network f2a08e65-1c6c-43fe-a019-78643e62bd9f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:27:17.937194 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Attempting to bind port ffe1f693-e5ac-4652-9079-c7b4eebd4317 on network f2a08e65-1c6c-43fe-a019-78643e62bd9f {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:27:17.942234 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 26, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:27:17.942573 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Checking segment: {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:27:17.942964 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Bound using segment: {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:27:17.943395 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Bound port: ffe1f693-e5ac-4652-9079-c7b4eebd4317, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:27:17.943751 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:18.012461 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] For port ffe1f693-e5ac-4652-9079-c7b4eebd4317, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:27:18.015917 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] For port ffe1f693-e5ac-4652-9079-c7b4eebd4317, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ffe1f693-e5ac-4652-9079-c7b4eebd4317,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:27:18.020999 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:18.058137 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:18.058754 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:18.060160 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] 10.222.0.31 "PUT /v2.0/ports/ffe1f693-e5ac-4652-9079-c7b4eebd4317 HTTP/1.1" status: 200 len: 1093 time: 0.9306293 Nov 18 18:27:18.060677 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'tag': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:27:18.062815 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0a0d00ed-6c03-409a-893c-1609421198ca" -d '{"events": [{"name": "network-changed", "server_uuid": "7ba78d1f-a71a-45bf-a563-918c2a5fceca", "tag": "ffe1f693-e5ac-4652-9079-c7b4eebd4317"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:27:18.092752 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f03a256f-d263-4a61-8859-ddc2783032cf service neutron] Pushing event updated for resources: {'Port': ['ID=ffe1f693-e5ac-4652-9079-c7b4eebd4317,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:18.116155 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:27:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25f06a81-bb98-40b1-b28a-d59ff8371a7f x-openstack-request-id: req-25f06a81-bb98-40b1-b28a-d59ff8371a7f {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:27:18.118443 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7ba78d1f-a71a-45bf-a563-918c2a5fceca", "tag": "ffe1f693-e5ac-4652-9079-c7b4eebd4317", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:27:18.118708 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-25f06a81-bb98-40b1-b28a-d59ff8371a7f {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:27:18.119111 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'tag': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317', 'status': 'completed', 'code': 200} Nov 18 18:27:18.170820 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-1b09e0b1-ad2f-43ea-acad-d5f2cbd832e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:18.172533 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-1b09e0b1-ad2f-43ea-acad-d5f2cbd832e3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1bab99f3344342578dc7b1c29b1ced7e&device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 1096 time: 0.0512831 Nov 18 18:27:18.217925 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-ecf12d22-6a30-49e1-9ce7-d9d8636c2cdd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ffe1f693-e5ac-4652-9079-c7b4eebd4317 HTTP/1.1" status: 200 len: 217 time: 0.0357988 Nov 18 18:27:18.277927 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-df9ec6b6-a042-42ab-a507-2c0e5ba9df46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:18.279481 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-df9ec6b6-a042-42ab-a507-2c0e5ba9df46 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=53535ce7-7c2a-450f-87e4-d092908ff080 HTTP/1.1" status: 200 len: 849 time: 0.0527081 Nov 18 18:27:18.330429 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-cfa2fc4d-5053-47ce-9bab-79b270b7b958 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:18.331920 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-cfa2fc4d-5053-47ce-9bab-79b270b7b958 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f2a08e65-1c6c-43fe-a019-78643e62bd9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0444655 Nov 18 18:27:18.429344 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-8e8ae3da-58e3-4b75-9218-c1f9d265f8c6 service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0876329 Nov 18 18:27:18.526852 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7bd46fbc-e0ed-48d9-88e0-a5405baf20bf req-c3712170-bd56-40d7-b76f-47f8c57cc124 service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0894253 Nov 18 18:27:18.617628 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a0d00ed-6c03-409a-893c-1609421198ca req-a399bf44-dbc9-49d3-a519-7bc862e6f079 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:18.617628 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0a0d00ed-6c03-409a-893c-1609421198ca req-a399bf44-dbc9-49d3-a519-7bc862e6f079 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1bab99f3344342578dc7b1c29b1ced7e&device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 1096 time: 0.0413184 Nov 18 18:27:18.639145 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43912) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:18.717909 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a0d00ed-6c03-409a-893c-1609421198ca req-0946b99a-9838-45a0-8c77-85959c68e62d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:18.720699 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0a0d00ed-6c03-409a-893c-1609421198ca req-0946b99a-9838-45a0-8c77-85959c68e62d service neutron] 10.222.0.31 "GET /v2.0/networks?id=f2a08e65-1c6c-43fe-a019-78643e62bd9f HTTP/1.1" status: 200 len: 912 time: 0.0892417 Nov 18 18:27:18.731907 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43916) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:18.763913 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0a0d00ed-6c03-409a-893c-1609421198ca req-ee256e70-2449-47ec-b530-63fc80a3e377 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ffe1f693-e5ac-4652-9079-c7b4eebd4317 HTTP/1.1" status: 200 len: 217 time: 0.0361466 Nov 18 18:27:18.820345 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a0d00ed-6c03-409a-893c-1609421198ca req-42a5ad9b-2234-409f-a5e9-4751e182d683 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:18.821015 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_v2 [None req-1ae2e737-a2e0-4d3c-b6ec-ec4242a0f757 admin admin] Deleting subnet 15a76039-95a8-4c78-b321-326b06094f8d {{(pid=102688) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:27:18.821558 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0a0d00ed-6c03-409a-893c-1609421198ca req-42a5ad9b-2234-409f-a5e9-4751e182d683 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=53535ce7-7c2a-450f-87e4-d092908ff080 HTTP/1.1" status: 200 len: 849 time: 0.0465422 Nov 18 18:27:18.825719 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1ae2e737-a2e0-4d3c-b6ec-ec4242a0f757 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:18.869787 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a0d00ed-6c03-409a-893c-1609421198ca req-687296c5-dbaf-4809-9ff7-cb2467a76ac1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:18.871224 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0a0d00ed-6c03-409a-893c-1609421198ca req-687296c5-dbaf-4809-9ff7-cb2467a76ac1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f2a08e65-1c6c-43fe-a019-78643e62bd9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0393806 Nov 18 18:27:18.898896 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1ae2e737-a2e0-4d3c-b6ec-ec4242a0f757 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14253791'] for subnet, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:18.975815 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1ae2e737-a2e0-4d3c-b6ec-ec4242a0f757 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:18.995908 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0a0d00ed-6c03-409a-893c-1609421198ca req-77aa4384-29c7-4707-85da-7e4af46625db service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1152806 Nov 18 18:27:19.003260 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab55bf4f-6dc9-4ba5-a333-1fb721af20db req-2627487e-0847-40c0-b858-2e8be34571db tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:19.004721 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ab55bf4f-6dc9-4ba5-a333-1fb721af20db req-2627487e-0847-40c0-b858-2e8be34571db tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 943 time: 0.0936468 Nov 18 18:27:19.092005 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1ae2e737-a2e0-4d3c-b6ec-ec4242a0f757 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-13993132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14505899'] for subnet, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.106765 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ab55bf4f-6dc9-4ba5-a333-1fb721af20db req-e2889fb5-4ea9-49b7-9983-a4f919c0c714 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=85be819a-494b-4bb1-8456-793f13c276c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0935597 Nov 18 18:27:19.126337 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0a0d00ed-6c03-409a-893c-1609421198ca req-f422b099-6433-4951-a83a-97c3d4883625 service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1206288 Nov 18 18:27:19.130055 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1ae2e737-a2e0-4d3c-b6ec-ec4242a0f757 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.133214 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-1ae2e737-a2e0-4d3c-b6ec-ec4242a0f757 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/15a76039-95a8-4c78-b321-326b06094f8d HTTP/1.1" status: 204 len: 168 time: 0.4003372 Nov 18 18:27:19.136394 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43920) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:19.140118 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ae2e737-a2e0-4d3c-b6ec-ec4242a0f757 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=15a76039-95a8-4c78-b321-326b06094f8d,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:19.203485 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.229248 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a6376f00-14cd-4432-9e1e-35f29b3d18ed admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-499121'] for router_interface, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.283495 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.304505 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['33a318b5-ad11-45c7-9380-7c9c44d250de']}} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:19.314921 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f13a496-1ac6-44ee-a618-9dee39276ca6') {'for_net_delete': True} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:19.315215 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f13a496-1ac6-44ee-a618-9dee39276ca6') {} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:19.326322 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12724807'] for segment, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.341356 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.348231 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] Releasing vlan 1322 on physical network physnet1 to pool {{(pid=102689) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:27:19.348641 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12723877'] for segment, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: Traceback (most recent call last): Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: timer() Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: cb(*args, **kw) Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: return func(*args, **kwargs) Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: self._notify() Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: self.callback(batched_events) Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: event.method(event) Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: return f(self, *a, **k) Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._get(url).json() Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: return self.request(url, 'GET', **kwargs) Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:27:19.350745 dv-cinder-787764-6-iscsi neutron-server[102689]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:27:19.411188 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.417779 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.421079 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] 10.222.0.82 "DELETE /v2.0/networks/33a318b5-ad11-45c7-9380-7c9c44d250de HTTP/1.1" status: 204 len: 168 time: 0.2836561 Nov 18 18:27:19.436434 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87a84f66-8c12-4d05-b5f3-0e8bac15a65d admin admin] Pushing event deleted for resources: {'Network': ['ID=33a318b5-ad11-45c7-9380-7c9c44d250de,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:19.604761 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43926) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:19.648563 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-a6c48199-587f-413b-a761-aa1c35eaafa7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c9e6e099470048148cdcfa828b9a32ea&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0425560 Nov 18 18:27:19.651246 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43928) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:19.700400 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9ce408ed-24b3-4723-928f-a75e76bcaaef admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.728847 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9ce408ed-24b3-4723-928f-a75e76bcaaef admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.757830 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-a6376f00-14cd-4432-9e1e-35f29b3d18ed admin admin] Deleting port 6401bf2f-1763-4e1c-9200-1fa1bff41750 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:27:19.759017 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a6376f00-14cd-4432-9e1e-35f29b3d18ed admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.778841 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9ce408ed-24b3-4723-928f-a75e76bcaaef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.782005 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9ce408ed-24b3-4723-928f-a75e76bcaaef admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.783301 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-9ce408ed-24b3-4723-928f-a75e76bcaaef admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5db6b05a-02c4-413e-92b0-d64c41b76294 HTTP/1.1" status: 204 len: 168 time: 0.1311491 Nov 18 18:27:19.791040 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ce408ed-24b3-4723-928f-a75e76bcaaef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5db6b05a-02c4-413e-92b0-d64c41b76294,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:19.844230 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-a6376f00-14cd-4432-9e1e-35f29b3d18ed admin admin] For port 6401bf2f-1763-4e1c-9200-1fa1bff41750, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=6401bf2f-1763-4e1c-9200-1fa1bff41750,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:19.844592 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a6376f00-14cd-4432-9e1e-35f29b3d18ed admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:19.858371 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-a6376f00-14cd-4432-9e1e-35f29b3d18ed admin admin] Calling delete_port for 6401bf2f-1763-4e1c-9200-1fa1bff41750 owned by network:router_interface {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:27:20.046759 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a6376f00-14cd-4432-9e1e-35f29b3d18ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:20.085445 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6376f00-14cd-4432-9e1e-35f29b3d18ed admin admin] Pushing event deleted for resources: {'Port': ['ID=6401bf2f-1763-4e1c-9200-1fa1bff41750,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:20.231824 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38e88584-d35b-4883-b504-de59b38398b1 req-4b383663-a5b4-48c6-a4f4-270abaee81e8 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:20.233443 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-38e88584-d35b-4883-b504-de59b38398b1 req-4b383663-a5b4-48c6-a4f4-270abaee81e8 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 943 time: 0.0509584 Nov 18 18:27:20.257856 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a6376f00-14cd-4432-9e1e-35f29b3d18ed admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1772491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-498973'] for router_interface, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:20.284499 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-38e88584-d35b-4883-b504-de59b38398b1 req-28eb5e75-c07a-4f33-b55c-e5d1b7624626 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=85be819a-494b-4bb1-8456-793f13c276c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450909 Nov 18 18:27:20.331004 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device e535328b-e6c3-4630-a314-5bd8ccdaad80 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:27:20.353312 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: e535328b-e6c3-4630-a314-5bd8ccdaad80 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:27:20.353571 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device e535328b-e6c3-4630-a314-5bd8ccdaad80 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:27:20.481924 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a6376f00-14cd-4432-9e1e-35f29b3d18ed admin admin] Router e8464c87-c9dc-43f0-9906-eda0c4a24cdb has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102688) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:27:20.585144 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a6376f00-14cd-4432-9e1e-35f29b3d18ed admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:27:20.591310 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a6376f00-14cd-4432-9e1e-35f29b3d18ed admin admin] 10.222.0.82 "PUT /v2.0/routers/e8464c87-c9dc-43f0-9906-eda0c4a24cdb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9508443 Nov 18 18:27:20.593896 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43936) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:20.595100 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1af2792d-9f90-4819-aa54-d37330e00021 None None] Sync routers for ids ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:27:20.606666 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1af2792d-9f90-4819-aa54-d37330e00021 None None] Routers {'e8464c87-c9dc-43f0-9906-eda0c4a24cdb'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:20.607367 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-1af2792d-9f90-4819-aa54-d37330e00021 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:20.696987 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Publish callbacks [] for router, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:20.708928 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-1af2792d-9f90-4819-aa54-d37330e00021 None None] Set router e8464c87-c9dc-43f0-9906-eda0c4a24cdb gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:20.800694 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:20.854354 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Deleting port 79ca7317-593f-4234-aa06-60a8ba1fdb61 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:27:20.854734 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:20.887876 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-1af2792d-9f90-4819-aa54-d37330e00021 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:27:19Z', 'revision_number': 5, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port': {'id': '79ca7317-593f-4234-aa06-60a8ba1fdb61', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:d9:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:23:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:20.913797 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1af2792d-9f90-4819-aa54-d37330e00021 None None] Checking router: e8464c87-c9dc-43f0-9906-eda0c4a24cdb for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:27:20.921970 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1af2792d-9f90-4819-aa54-d37330e00021 None None] Routers {'e8464c87-c9dc-43f0-9906-eda0c4a24cdb'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:20.922570 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-1af2792d-9f90-4819-aa54-d37330e00021 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:20.933366 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] For port 79ca7317-593f-4234-aa06-60a8ba1fdb61, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=79ca7317-593f-4234-aa06-60a8ba1fdb61,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:20.933758 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:20.946562 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Calling delete_port for 79ca7317-593f-4234-aa06-60a8ba1fdb61 owned by network:router_gateway {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:27:21.006034 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-1af2792d-9f90-4819-aa54-d37330e00021 None None] Set router e8464c87-c9dc-43f0-9906-eda0c4a24cdb gateway port host: None {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:21.059070 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-1af2792d-9f90-4819-aa54-d37330e00021 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:27:20Z', 'revision_number': 6, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port_host': None}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:21.085414 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1af2792d-9f90-4819-aa54-d37330e00021 None None] The sync data for ids ['e8464c87-c9dc-43f0-9906-eda0c4a24cdb'] in dv-cinder-787764-6-iscsi is: [{'id': 'e8464c87-c9dc-43f0-9906-eda0c4a24cdb', 'name': 'tempest-TestMinimumBasicScenario-1941240008-router', 'tenant_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:27Z', 'updated_at': '2021-11-18T18:27:20Z', 'revision_number': 6, 'project_id': '46a1cb48de6e4f43a563f40fd92f0bf0', 'gw_port_host': None}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:27:21.118146 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.141628 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Pushing event deleted for resources: {'Port': ['ID=79ca7317-593f-4234-aa06-60a8ba1fdb61,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:21.145522 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.205632 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-500475'] for router_gateway, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.305478 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-430336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-557'] for router, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.307612 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.372455 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-430347'] for router, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.372900 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Fanout notify agent at l3_agent the message router_deleted on router e8464c87-c9dc-43f0-9906-eda0c4a24cdb {{(pid=102688) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 18:27:21.378120 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] Publish callbacks [] for router, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.381658 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-92d3cb23-b9ac-44ed-8bc6-c4dd2244fc4c admin admin] 10.222.0.82 "DELETE /v2.0/routers/e8464c87-c9dc-43f0-9906-eda0c4a24cdb HTTP/1.1" status: 204 len: 168 time: 0.7845669 Nov 18 18:27:21.382102 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43940) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:21.405170 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e79201c-3fed-4e10-8f77-1d7135207673 req-6fda41ec-6639-4331-82b7-e823934d982b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:21.406778 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3e79201c-3fed-4e10-8f77-1d7135207673 req-6fda41ec-6639-4331-82b7-e823934d982b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 943 time: 0.0554769 Nov 18 18:27:21.430158 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_v2 [None req-399fa7dc-cbb6-4b2c-9ffc-583e4b4f951b admin admin] Deleting subnet 24097eeb-7eeb-4617-b83d-a363de5de9b1 {{(pid=102688) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:27:21.433416 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-399fa7dc-cbb6-4b2c-9ffc-583e4b4f951b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.458525 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3e79201c-3fed-4e10-8f77-1d7135207673 req-886e99c5-c442-4c8e-9ca1-fb1191073efa tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=85be819a-494b-4bb1-8456-793f13c276c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452869 Nov 18 18:27:21.473268 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-399fa7dc-cbb6-4b2c-9ffc-583e4b4f951b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14253791'] for subnet, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.583466 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-399fa7dc-cbb6-4b2c-9ffc-583e4b4f951b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.636384 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-399fa7dc-cbb6-4b2c-9ffc-583e4b4f951b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-13993132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14505899'] for subnet, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.660369 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-399fa7dc-cbb6-4b2c-9ffc-583e4b4f951b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=24097eeb-7eeb-4617-b83d-a363de5de9b1,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:21.666609 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-399fa7dc-cbb6-4b2c-9ffc-583e4b4f951b admin admin] Publish callbacks [] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.670032 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-399fa7dc-cbb6-4b2c-9ffc-583e4b4f951b admin admin] 10.222.0.82 "DELETE /v2.0/subnets/24097eeb-7eeb-4617-b83d-a363de5de9b1 HTTP/1.1" status: 204 len: 168 time: 0.2868724 Nov 18 18:27:21.672037 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d217a638-80a3-4350-a963-6b1df20ef217 None None] Network c5332eb5-c186-4bcf-89d9-eb78be973548 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:27:21.672870 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43944) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:21.741995 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.793721 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Deleting port 18e6fda8-f433-4a69-be2a-ef1bb908d69b {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:27:21.793976 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.858201 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] For port 18e6fda8-f433-4a69-be2a-ef1bb908d69b, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=18e6fda8-f433-4a69-be2a-ef1bb908d69b,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:21.858802 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.864909 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec0ff33e-aaf4-421a-86f1-61907e33703b None None] DHCP port deletion for c5332eb5-c186-4bcf-89d9-eb78be973548 request from dv-cinder-787764-6-iscsi {{(pid=102690) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 18:27:21.875079 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Calling delete_port for 18e6fda8-f433-4a69-be2a-ef1bb908d69b owned by network:dhcp {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:27:21.913742 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-ec0ff33e-aaf4-421a-86f1-61907e33703b None None] Deleting port 18e6fda8-f433-4a69-be2a-ef1bb908d69b {{(pid=102690) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:27:21.914026 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-ec0ff33e-aaf4-421a-86f1-61907e33703b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.954831 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:21.985181 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Pushing event deleted for resources: {'Port': ['ID=18e6fda8-f433-4a69-be2a-ef1bb908d69b,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:21.990927 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] No DVR routers for this DVR port 18e6fda8-f433-4a69-be2a-ef1bb908d69b on host dv-cinder-787764-6-iscsi {{(pid=102688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:27:22.103695 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-ec0ff33e-aaf4-421a-86f1-61907e33703b None None] For port 18e6fda8-f433-4a69-be2a-ef1bb908d69b, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=18e6fda8-f433-4a69-be2a-ef1bb908d69b,segment=NetworkSegment(6a4ec92d-4943-4121-a1de-1611106781cb),segment_id=6a4ec92d-4943-4121-a1de-1611106781cb)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:22.104131 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-ec0ff33e-aaf4-421a-86f1-61907e33703b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:22.118590 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-ec0ff33e-aaf4-421a-86f1-61907e33703b None None] Calling delete_port for 18e6fda8-f433-4a69-be2a-ef1bb908d69b owned by network:dhcp {{(pid=102690) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:27:22.238851 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-ec0ff33e-aaf4-421a-86f1-61907e33703b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596'] for port, after_delete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:22.268228 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec0ff33e-aaf4-421a-86f1-61907e33703b None None] Pushing event deleted for resources: {'Port': ['ID=18e6fda8-f433-4a69-be2a-ef1bb908d69b,revision_number=None']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:22.274047 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec0ff33e-aaf4-421a-86f1-61907e33703b None None] No DVR routers for this DVR port 18e6fda8-f433-4a69-be2a-ef1bb908d69b on host dv-cinder-787764-6-iscsi {{(pid=102690) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:27:22.297130 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:22.319087 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c5332eb5-c186-4bcf-89d9-eb78be973548']}} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:22.329975 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6a4ec92d-4943-4121-a1de-1611106781cb') {'for_net_delete': True} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:22.330282 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6a4ec92d-4943-4121-a1de-1611106781cb') {} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:22.332679 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device ffe1f693-e5ac-4652-9079-c7b4eebd4317 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:27:22.341996 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14253766'] for segment, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:22.370808 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:22.378575 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Releasing vlan 1305 on physical network physnet1 to pool {{(pid=102688) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:27:22.379304 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-13993202'] for segment, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: Traceback (most recent call last): Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: timer() Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: cb(*args, **kw) Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: return func(*args, **kwargs) Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: self._notify() Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: self.callback(batched_events) Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: event.method(event) Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: return f(self, *a, **k) Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._get(url).json() Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: return self.request(url, 'GET', **kwargs) Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:27:22.381567 dv-cinder-787764-6-iscsi neutron-server[102688]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:27:22.409615 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5f864af8-9a6a-468b-bbfe-c708f4be9570 req-9c2244e7-dc8e-4099-9675-17508d7e6fe3 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0741615 Nov 18 18:27:22.421318 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 18e6fda8-f433-4a69-be2a-ef1bb908d69b no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:27:22.444966 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 18e6fda8-f433-4a69-be2a-ef1bb908d69b {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:27:22.445316 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 18e6fda8-f433-4a69-be2a-ef1bb908d69b not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:27:22.445955 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 79ca7317-593f-4234-aa06-60a8ba1fdb61 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:27:22.449511 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:22.456502 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:22.462985 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] 10.222.0.82 "DELETE /v2.0/networks/c5332eb5-c186-4bcf-89d9-eb78be973548 HTTP/1.1" status: 204 len: 168 time: 0.7863359 Nov 18 18:27:22.464348 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43946) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:22.479345 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a34e66-5988-4ab2-aad1-5fa12db3f288 admin admin] Pushing event deleted for resources: {'Network': ['ID=c5332eb5-c186-4bcf-89d9-eb78be973548,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:22.490704 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port ffe1f693-e5ac-4652-9079-c7b4eebd4317, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ffe1f693-e5ac-4652-9079-c7b4eebd4317,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:22.505628 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 79ca7317-593f-4234-aa06-60a8ba1fdb61 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:27:22.505990 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 79ca7317-593f-4234-aa06-60a8ba1fdb61 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:27:22.506695 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 6401bf2f-1763-4e1c-9200-1fa1bff41750 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:27:22.508688 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'port_id': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317', 'mac_address': 'fa:16:3e:b7:53:ef', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1348, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:27:22.523620 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f864af8-9a6a-468b-bbfe-c708f4be9570 req-b6bf1b34-7058-4c69-98ba-0148bbb3d451 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:22.528361 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5f864af8-9a6a-468b-bbfe-c708f4be9570 req-b6bf1b34-7058-4c69-98ba-0148bbb3d451 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=029e580af1e3498aa00c86f5ce660a80&device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 1099 time: 0.0708501 Nov 18 18:27:22.530664 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 6401bf2f-1763-4e1c-9200-1fa1bff41750 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:27:22.531021 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 6401bf2f-1763-4e1c-9200-1fa1bff41750 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:27:22.573690 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:22.586685 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ffe1f693-e5ac-4652-9079-c7b4eebd4317 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:27:22.609707 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port ffe1f693-e5ac-4652-9079-c7b4eebd4317, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ffe1f693-e5ac-4652-9079-c7b4eebd4317,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:22.615309 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:22.647393 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc7e5f8-4343-4fc5-94dc-5fa9c93edf03 req-835adab5-95ff-4ecd-8382-f427a8310f46 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:22.648916 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6dc7e5f8-4343-4fc5-94dc-5fa9c93edf03 req-835adab5-95ff-4ecd-8382-f427a8310f46 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 943 time: 0.1171134 Nov 18 18:27:22.678213 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=ffe1f693-e5ac-4652-9079-c7b4eebd4317,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:22.709179 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f864af8-9a6a-468b-bbfe-c708f4be9570 req-0fa2fdd0-2c40-4527-b7b1-3f2d15da0cf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:22.710665 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5f864af8-9a6a-468b-bbfe-c708f4be9570 req-0fa2fdd0-2c40-4527-b7b1-3f2d15da0cf5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a HTTP/1.1" status: 200 len: 909 time: 0.1408770 Nov 18 18:27:22.774255 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6dc7e5f8-4343-4fc5-94dc-5fa9c93edf03 req-1c98ad69-851c-4463-9ca6-24a03d5cf3a3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=85be819a-494b-4bb1-8456-793f13c276c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1105170 Nov 18 18:27:22.799194 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5f864af8-9a6a-468b-bbfe-c708f4be9570 req-fdb1d054-5138-4e51-bc2b-a584490d3c9d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f HTTP/1.1" status: 200 len: 1001 time: 0.0769715 Nov 18 18:27:22.852988 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f864af8-9a6a-468b-bbfe-c708f4be9570 req-26bac3b2-f3b3-4072-b49d-9e643cead2a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:22.854497 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5f864af8-9a6a-468b-bbfe-c708f4be9570 req-26bac3b2-f3b3-4072-b49d-9e643cead2a0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cac1be0a-3676-49bd-8292-3623cc0fc8b1 HTTP/1.1" status: 200 len: 846 time: 0.0437098 Nov 18 18:27:22.863381 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e382f2df-bfc3-404f-9073-0675e412391f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-499121'] for router_interface, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:22.883822 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['ffe1f693-e5ac-4652-9079-c7b4eebd4317'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:27:22.904189 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f864af8-9a6a-468b-bbfe-c708f4be9570 req-da558e91-7e8e-4f99-a5e3-350c53b4e6fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:22.906227 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5f864af8-9a6a-468b-bbfe-c708f4be9570 req-da558e91-7e8e-4f99-a5e3-350c53b4e6fb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0423017 Nov 18 18:27:23.014064 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5f864af8-9a6a-468b-bbfe-c708f4be9570 req-2f53e7e2-03b9-4621-8ef9-e1c5c7bd640f service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0900512 Nov 18 18:27:23.105604 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5f864af8-9a6a-468b-bbfe-c708f4be9570 req-44ecd8b2-3c99-42e2-9079-f53726219975 service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830023 Nov 18 18:27:23.110249 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-e382f2df-bfc3-404f-9073-0675e412391f admin admin] Deleting port afc98e3b-9711-4de0-a528-319542997a98 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:27:23.110600 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e382f2df-bfc3-404f-9073-0675e412391f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:23.190435 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-e382f2df-bfc3-404f-9073-0675e412391f admin admin] For port afc98e3b-9711-4de0-a528-319542997a98, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=afc98e3b-9711-4de0-a528-319542997a98,segment=NetworkSegment(539f465f-adce-4bb3-b0bd-ed843ee5ddbd),segment_id=539f465f-adce-4bb3-b0bd-ed843ee5ddbd)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:23.190828 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e382f2df-bfc3-404f-9073-0675e412391f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:23.206693 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-e382f2df-bfc3-404f-9073-0675e412391f admin admin] Calling delete_port for afc98e3b-9711-4de0-a528-319542997a98 owned by network:router_interface {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:27:23.381845 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e382f2df-bfc3-404f-9073-0675e412391f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:23.406260 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e382f2df-bfc3-404f-9073-0675e412391f admin admin] Pushing event deleted for resources: {'Port': ['ID=afc98e3b-9711-4de0-a528-319542997a98,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:23.570299 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e382f2df-bfc3-404f-9073-0675e412391f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1772491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-498973'] for router_interface, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:23.782670 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e382f2df-bfc3-404f-9073-0675e412391f admin admin] Router 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102688) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:27:23.890706 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e382f2df-bfc3-404f-9073-0675e412391f admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:27:23.893650 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc02eb44-7903-4978-8086-a5cb66d3ee81 req-cc536d43-7f1b-4e8c-be79-42b8f3797c67 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:23.895162 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bc02eb44-7903-4978-8086-a5cb66d3ee81 req-cc536d43-7f1b-4e8c-be79-42b8f3797c67 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 944 time: 0.0526390 Nov 18 18:27:23.897620 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-e382f2df-bfc3-404f-9073-0675e412391f admin admin] 10.222.0.82 "PUT /v2.0/routers/2de1c8b7-3943-484e-a8c5-7c4d3d416fdc/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4321592 Nov 18 18:27:23.899663 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43956) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:23.903588 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e873e148-26e0-4418-b331-a359ab0e6db7 None None] Sync routers for ids ['2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:27:23.913670 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e873e148-26e0-4418-b331-a359ab0e6db7 None None] Routers {'2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:23.914261 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-e873e148-26e0-4418-b331-a359ab0e6db7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:23.943776 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bc02eb44-7903-4978-8086-a5cb66d3ee81 req-864cfad1-d18e-4131-9622-fd920ea9fb2b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=85be819a-494b-4bb1-8456-793f13c276c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416164 Nov 18 18:27:24.004626 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Publish callbacks [] for router, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.101955 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-e873e148-26e0-4418-b331-a359ab0e6db7 None None] Set router 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:24.109122 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.161237 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Deleting port a5d9899d-154d-4e99-9bd1-5124d0b912d0 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:27:24.161581 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.238744 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] For port a5d9899d-154d-4e99-9bd1-5124d0b912d0, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=a5d9899d-154d-4e99-9bd1-5124d0b912d0,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:24.239109 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.255556 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Calling delete_port for a5d9899d-154d-4e99-9bd1-5124d0b912d0 owned by network:router_gateway {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:27:24.276890 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-e873e148-26e0-4418-b331-a359ab0e6db7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'name': 'tempest-TestMinimumBasicScenario-746634804-router', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220'}], 'enable_snat': True}, 'gw_port_id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:36Z', 'updated_at': '2021-11-18T18:27:23Z', 'revision_number': 5, 'project_id': '165504901a854a98988fc6ac8b063e92', 'gw_port': {'id': 'a5d9899d-154d-4e99-9bd1-5124d0b912d0', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:bd:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:37Z', 'updated_at': '2021-11-18T18:23:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:24.301679 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e873e148-26e0-4418-b331-a359ab0e6db7 None None] Checking router: 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:27:24.310023 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e873e148-26e0-4418-b331-a359ab0e6db7 None None] Routers {'2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:24.310607 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-e873e148-26e0-4418-b331-a359ab0e6db7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:24.332120 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device ffe1f693-e5ac-4652-9079-c7b4eebd4317 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:24.392683 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port ffe1f693-e5ac-4652-9079-c7b4eebd4317 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:27:24.396652 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port ffe1f693-e5ac-4652-9079-c7b4eebd4317 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:24.397104 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.406852 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-e873e148-26e0-4418-b331-a359ab0e6db7 None None] Set router 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc gateway port host: None {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:24.443366 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.463893 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-e873e148-26e0-4418-b331-a359ab0e6db7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'name': 'tempest-TestMinimumBasicScenario-746634804-router', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:36Z', 'updated_at': '2021-11-18T18:27:24Z', 'revision_number': 6, 'project_id': '165504901a854a98988fc6ac8b063e92', 'gw_port_host': None}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:24.476213 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Pushing event deleted for resources: {'Port': ['ID=a5d9899d-154d-4e99-9bd1-5124d0b912d0,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:24.486088 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.492767 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e873e148-26e0-4418-b331-a359ab0e6db7 None None] The sync data for ids ['2de1c8b7-3943-484e-a8c5-7c4d3d416fdc'] in dv-cinder-787764-6-iscsi is: [{'id': '2de1c8b7-3943-484e-a8c5-7c4d3d416fdc', 'name': 'tempest-TestMinimumBasicScenario-746634804-router', 'tenant_id': '165504901a854a98988fc6ac8b063e92', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:36Z', 'updated_at': '2021-11-18T18:27:24Z', 'revision_number': 6, 'project_id': '165504901a854a98988fc6ac8b063e92', 'gw_port_host': None}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:27:24.514830 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:27:24.517223 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2744295c-7697-479a-a8ca-78262f4b2918" -d '{"events": [{"server_uuid": "7ba78d1f-a71a-45bf-a563-918c2a5fceca", "name": "network-vif-plugged", "status": "completed", "tag": "ffe1f693-e5ac-4652-9079-c7b4eebd4317"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:27:24.540747 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port ffe1f693-e5ac-4652-9079-c7b4eebd4317, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ffe1f693-e5ac-4652-9079-c7b4eebd4317,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:24.543497 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-500475'] for router_gateway, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.545610 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.570115 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:27:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d8f56ac-75aa-483b-9497-1ab8efca652d x-openstack-request-id: req-1d8f56ac-75aa-483b-9497-1ab8efca652d {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:27:24.570412 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ba78d1f-a71a-45bf-a563-918c2a5fceca", "name": "network-vif-plugged", "status": "completed", "tag": "ffe1f693-e5ac-4652-9079-c7b4eebd4317", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:27:24.570671 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-1d8f56ac-75aa-483b-9497-1ab8efca652d {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:27:24.571067 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317', 'code': 200} Nov 18 18:27:24.597543 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=ffe1f693-e5ac-4652-9079-c7b4eebd4317,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:24.643718 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-430336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-557'] for router, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.645957 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.688615 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-430347'] for router, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.689139 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2de1c8b7-3943-484e-a8c5-7c4d3d416fdc {{(pid=102688) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 18:27:24.693401 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] Publish callbacks [] for router, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.694577 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a5ab363b-c9f7-4705-a60e-00bfd9688d8c admin admin] 10.222.0.82 "DELETE /v2.0/routers/2de1c8b7-3943-484e-a8c5-7c4d3d416fdc HTTP/1.1" status: 204 len: 168 time: 0.7939274 Nov 18 18:27:24.697100 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43960) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:24.727562 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194c75ef-63ea-472e-bac8-1e9a5c744917 req-2862807c-de48-43a9-84f1-d95c777a8deb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:24.729618 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-194c75ef-63ea-472e-bac8-1e9a5c744917 req-2862807c-de48-43a9-84f1-d95c777a8deb service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 1098 time: 0.0406988 Nov 18 18:27:24.745041 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_v2 [None req-b18ea8b0-70ac-4d87-8a87-f6084c1f633c admin admin] Deleting subnet 4e48127f-a501-4b91-b5fa-da7f1c7a9a7c {{(pid=102688) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:27:24.748117 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b18ea8b0-70ac-4d87-8a87-f6084c1f633c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.775475 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-194c75ef-63ea-472e-bac8-1e9a5c744917 req-b49b0b24-1199-4fb2-854d-c5dc01417a04 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=85be819a-494b-4bb1-8456-793f13c276c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0374615 Nov 18 18:27:24.782094 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b18ea8b0-70ac-4d87-8a87-f6084c1f633c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14253791'] for subnet, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.857266 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b18ea8b0-70ac-4d87-8a87-f6084c1f633c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.917714 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b18ea8b0-70ac-4d87-8a87-f6084c1f633c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-13993132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14505899'] for subnet, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.942878 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b18ea8b0-70ac-4d87-8a87-f6084c1f633c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4e48127f-a501-4b91-b5fa-da7f1c7a9a7c,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:24.948514 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b18ea8b0-70ac-4d87-8a87-f6084c1f633c admin admin] Publish callbacks [] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:24.951764 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-b18ea8b0-70ac-4d87-8a87-f6084c1f633c admin admin] 10.222.0.82 "DELETE /v2.0/subnets/4e48127f-a501-4b91-b5fa-da7f1c7a9a7c HTTP/1.1" status: 204 len: 168 time: 0.2536619 Nov 18 18:27:24.953885 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73c16569-6250-4ecb-8200-47e279476366 None None] Network 2790170f-8235-48ba-90b7-703cb0e757b6 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:27:24.954327 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43964) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:25.022571 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.067529 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96849826-934b-4162-a53f-a98b536b1453 req-d59a3c4e-499c-4788-a0d1-a0375b2b38d5 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:25.069489 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-96849826-934b-4162-a53f-a98b536b1453 req-d59a3c4e-499c-4788-a0d1-a0375b2b38d5 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 945 time: 0.0535986 Nov 18 18:27:25.084209 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Deleting port 23bd19ff-4e26-46ff-bf20-146c16b30884 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:27:25.084592 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.120606 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-96849826-934b-4162-a53f-a98b536b1453 req-b33fc27b-f433-4cea-97aa-e41c6a026fa6 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=85be819a-494b-4bb1-8456-793f13c276c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437493 Nov 18 18:27:25.153915 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] For port 23bd19ff-4e26-46ff-bf20-146c16b30884, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=23bd19ff-4e26-46ff-bf20-146c16b30884,segment=NetworkSegment(539f465f-adce-4bb3-b0bd-ed843ee5ddbd),segment_id=539f465f-adce-4bb3-b0bd-ed843ee5ddbd)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:25.154275 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.165786 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Calling delete_port for 23bd19ff-4e26-46ff-bf20-146c16b30884 owned by network:dhcp {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:27:25.241541 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.271703 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] No DVR routers for this DVR port 23bd19ff-4e26-46ff-bf20-146c16b30884 on host dv-cinder-787764-6-iscsi {{(pid=102688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:27:25.276208 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Pushing event deleted for resources: {'Port': ['ID=23bd19ff-4e26-46ff-bf20-146c16b30884,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:25.287315 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-656ea4db-0884-49aa-b458-cd84ac3d5f1a None None] DHCP port deletion for 2790170f-8235-48ba-90b7-703cb0e757b6 request from dv-cinder-787764-6-iscsi {{(pid=102690) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 18:27:25.348744 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.368739 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2790170f-8235-48ba-90b7-703cb0e757b6']}} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:25.378226 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '539f465f-adce-4bb3-b0bd-ed843ee5ddbd') {'for_net_delete': True} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:25.378527 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '539f465f-adce-4bb3-b0bd-ed843ee5ddbd') {} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:25.392307 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14253766'] for segment, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.406056 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.411741 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Releasing vlan 1323 on physical network physnet1 to pool {{(pid=102688) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:27:25.412153 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-13993202'] for segment, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: Traceback (most recent call last): Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: timer() Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: cb(*args, **kw) Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: return func(*args, **kwargs) Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: self._notify() Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: self.callback(batched_events) Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: event.method(event) Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: return f(self, *a, **k) Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._get(url).json() Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: return self.request(url, 'GET', **kwargs) Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:27:25.413826 dv-cinder-787764-6-iscsi neutron-server[102688]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:27:25.468453 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.474160 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.477449 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] 10.222.0.82 "DELETE /v2.0/networks/2790170f-8235-48ba-90b7-703cb0e757b6 HTTP/1.1" status: 204 len: 168 time: 0.5221806 Nov 18 18:27:25.489249 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f4e19fb-ceae-4a56-aa29-754d98495d51 admin admin] Pushing event deleted for resources: {'Network': ['ID=2790170f-8235-48ba-90b7-703cb0e757b6,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:25.642004 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43970) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:25.680720 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-40329b52-8c23-465e-a12e-156ab63ed675 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=46a1cb48de6e4f43a563f40fd92f0bf0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0375278 Nov 18 18:27:25.683588 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 43972) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:25.731137 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4caa1206-25f0-4a4f-bc08-ffde237a2216 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.761888 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4caa1206-25f0-4a4f-bc08-ffde237a2216 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.810848 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4caa1206-25f0-4a4f-bc08-ffde237a2216 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.813333 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-4caa1206-25f0-4a4f-bc08-ffde237a2216 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:25.814496 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-4caa1206-25f0-4a4f-bc08-ffde237a2216 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/dd5cdf9b-ed90-4f2d-90c9-38ebebf71969 HTTP/1.1" status: 204 len: 168 time: 0.1299405 Nov 18 18:27:25.823193 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4caa1206-25f0-4a4f-bc08-ffde237a2216 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd5cdf9b-ed90-4f2d-90c9-38ebebf71969,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:26.137769 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43980) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:26.186379 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-3db66631-8fbb-4eda-b04c-024efed1fece admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=165504901a854a98988fc6ac8b063e92&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0474467 Nov 18 18:27:26.188810 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43984) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:26.267293 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1725dfb4-15d1-4d9c-b4f2-5e0ef309df3d req-c1eeabc6-719f-489d-afd8-95e9b195afc3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:26.268823 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1725dfb4-15d1-4d9c-b4f2-5e0ef309df3d req-c1eeabc6-719f-489d-afd8-95e9b195afc3 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 945 time: 0.0714860 Nov 18 18:27:26.284462 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:26.334851 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:26.355047 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1725dfb4-15d1-4d9c-b4f2-5e0ef309df3d req-46e408ee-5406-4634-b4f9-6b017cba6bd2 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=85be819a-494b-4bb1-8456-793f13c276c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0790472 Nov 18 18:27:26.384822 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device a5d9899d-154d-4e99-9bd1-5124d0b912d0 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:27:26.400941 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:26.405044 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: a5d9899d-154d-4e99-9bd1-5124d0b912d0 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:27:26.405396 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device a5d9899d-154d-4e99-9bd1-5124d0b912d0 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:27:26.405824 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device afc98e3b-9711-4de0-a528-319542997a98 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:27:26.406878 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:26.408114 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cfe2b7db-ac3e-45d7-867b-7b8742065d79 HTTP/1.1" status: 204 len: 168 time: 0.2180734 Nov 18 18:27:26.423737 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cfe2b7db-ac3e-45d7-867b-7b8742065d79,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:26.431290 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: afc98e3b-9711-4de0-a528-319542997a98 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:27:26.432487 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device afc98e3b-9711-4de0-a528-319542997a98 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:27:26.433098 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 23bd19ff-4e26-46ff-bf20-146c16b30884 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:27:26.442615 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:26.443001 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:26.443346 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:26.443696 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:26.444095 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:26.444439 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:26.444824 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:26.445211 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:26.445605 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:26.445964 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:26.446353 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:26.446795 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18fdb015-b2d2-4e63-afa9-24d0ca7a7c1b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:26.455179 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 23bd19ff-4e26-46ff-bf20-146c16b30884 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:27:26.455529 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 23bd19ff-4e26-46ff-bf20-146c16b30884 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:27:26.493705 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c06a4e5-d033-43a4-b61b-27db5d1616a3 req-a1700926-5c72-48d2-b03b-cb0b5abffb4f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:26.495232 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9c06a4e5-d033-43a4-b61b-27db5d1616a3 req-a1700926-5c72-48d2-b03b-cb0b5abffb4f tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 945 time: 0.0666239 Nov 18 18:27:26.503693 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 43990) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:26.508684 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-2bd6c444-00dc-482c-9365-4598c3c646a0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Request body: {'floatingip': {'port_id': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:26.548257 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2bd6c444-00dc-482c-9365-4598c3c646a0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:26.990791 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2bd6c444-00dc-482c-9365-4598c3c646a0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:26.994881 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2bd6c444-00dc-482c-9365-4598c3c646a0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.095652 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [None req-2bd6c444-00dc-482c-9365-4598c3c646a0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Floating IP 36abcff2-4b6b-4296-a87c-ed3ece2c4391 associated. External IP: 172.27.1.83, port: ffe1f693-e5ac-4652-9079-c7b4eebd4317. Nov 18 18:27:27.127578 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44010) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:27.225096 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-182033318-network', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:27.248171 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Made reservation on behalf of d08a29a317934e72a71b69340d23cd0b for: {'network': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:27:27.250676 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.259434 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.302573 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2bd6c444-00dc-482c-9365-4598c3c646a0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Router 9674107a-752c-42c3-a133-60c85d951af8 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:27:27.336109 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.339766 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.366625 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1326} {{(pid=102688) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:27:27.373476 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14cb5f68-189c-42dc-bf58-26397b735ee6,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:27.380719 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.381631 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.segments_db [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Added segment 50c99b05-6341-4b99-80f2-ffdf7a114b2c of type vlan for network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 Nov 18 18:27:27.410103 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2bd6c444-00dc-482c-9365-4598c3c646a0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:27:27.414677 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2bd6c444-00dc-482c-9365-4598c3c646a0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.421091 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03bf61ae-8a8e-4074-8823-fc0949f36a41 None None] Sync routers for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:27:27.423062 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.431389 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03bf61ae-8a8e-4074-8823-fc0949f36a41 None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:27.432771 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-03bf61ae-8a8e-4074-8823-fc0949f36a41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:27.441406 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-2bd6c444-00dc-482c-9365-4598c3c646a0 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "PUT /v2.0/floatingips/36abcff2-4b6b-4296-a87c-ed3ece2c4391 HTTP/1.1" status: 200 len: 990 time: 0.9366565 Nov 18 18:27:27.442063 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'tag': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:27:27.444696 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50af266e-121a-4049-b19a-91d90a15e699" -d '{"events": [{"name": "network-changed", "server_uuid": "7ba78d1f-a71a-45bf-a563-918c2a5fceca", "tag": "ffe1f693-e5ac-4652-9079-c7b4eebd4317"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:27:27.468587 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.469743 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:27.470432 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.496030 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:27:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d5633ff4-bc11-4fe8-b212-5c846cd4cd7c x-openstack-request-id: req-d5633ff4-bc11-4fe8-b212-5c846cd4cd7c {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:27:27.496673 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7ba78d1f-a71a-45bf-a563-918c2a5fceca", "tag": "ffe1f693-e5ac-4652-9079-c7b4eebd4317", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:27:27.497165 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-d5633ff4-bc11-4fe8-b212-5c846cd4cd7c {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:27:27.497707 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'tag': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317', 'status': 'completed', 'code': 200} Nov 18 18:27:27.503329 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.3744338 Nov 18 18:27:27.506409 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44020) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:27.513478 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-9bf9a52d-2751-4204-a8f3-ca46d69cfc9c admin admin] Request body: {'subnet': {'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-182033318-subnet', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'ip_version': 4}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:27.552778 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-03bf61ae-8a8e-4074-8823-fc0949f36a41 None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:27.564996 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af20d302-eb1b-410e-aed6-3b265d6aa396 admin admin] Pushing event updated for resources: {'Network': ['ID=1cf7f705-4c7c-4525-bcfb-71db85eb96a0,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:27.577188 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9bf9a52d-2751-4204-a8f3-ca46d69cfc9c admin admin] Made reservation on behalf of d08a29a317934e72a71b69340d23cd0b for: {'subnet': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:27:27.579516 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9bf9a52d-2751-4204-a8f3-ca46d69cfc9c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14505870'] for subnet, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.583261 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:27:27.586355 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50af266e-121a-4049-b19a-91d90a15e699 req-81ed9741-d769-435b-a132-93aa7dab7e79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:27.589362 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50af266e-121a-4049-b19a-91d90a15e699 req-81ed9741-d769-435b-a132-93aa7dab7e79 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1bab99f3344342578dc7b1c29b1ced7e&device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 1098 time: 0.0554914 Nov 18 18:27:27.690322 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50af266e-121a-4049-b19a-91d90a15e699 req-17dc32eb-cbdb-4eca-9b2c-81cb2e389341 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:27.692854 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50af266e-121a-4049-b19a-91d90a15e699 req-17dc32eb-cbdb-4eca-9b2c-81cb2e389341 service neutron] 10.222.0.31 "GET /v2.0/networks?id=f2a08e65-1c6c-43fe-a019-78643e62bd9f HTTP/1.1" status: 200 len: 912 time: 0.0916293 Nov 18 18:27:27.752364 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9bf9a52d-2751-4204-a8f3-ca46d69cfc9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-13993069', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14505888'] for subnet, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.758330 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50af266e-121a-4049-b19a-91d90a15e699 req-f88314f7-8738-4e12-8c5e-e61a75bffa38 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ffe1f693-e5ac-4652-9079-c7b4eebd4317 HTTP/1.1" status: 200 len: 998 time: 0.0587397 Nov 18 18:27:27.819075 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50af266e-121a-4049-b19a-91d90a15e699 req-5fa79548-6fdb-4a83-baab-f1ef75195bcc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:27.820594 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50af266e-121a-4049-b19a-91d90a15e699 req-5fa79548-6fdb-4a83-baab-f1ef75195bcc service neutron] 10.222.0.31 "GET /v2.0/subnets?id=53535ce7-7c2a-450f-87e4-d092908ff080 HTTP/1.1" status: 200 len: 849 time: 0.0498891 Nov 18 18:27:27.823004 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bf9a52d-2751-4204-a8f3-ca46d69cfc9c admin admin] Pushing event updated for resources: {'Subnet': ['ID=3cd0c89d-cb17-425f-b060-6f88dbc2e31b,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:27.828365 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bf9a52d-2751-4204-a8f3-ca46d69cfc9c admin admin] Checking segment: {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:27:27.828730 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9bf9a52d-2751-4204-a8f3-ca46d69cfc9c admin admin] Network hostable DHCP agents. Network: 1cf7f705-4c7c-4525-bcfb-71db85eb96a0, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102688) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:27:27.849188 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9bf9a52d-2751-4204-a8f3-ca46d69cfc9c admin admin] Network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102688) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:27:27.858177 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-03bf61ae-8a8e-4074-8823-fc0949f36a41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '36abcff2-4b6b-4296-a87c-ed3ece2c4391', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'floating_ip_address': '172.27.1.83', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '9674107a-752c-42c3-a133-60c85d951af8', 'port_id': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 533, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'mac_address': 'fa:16:3e:b7:53:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:27:14Z', 'updated_at': '2021-11-18T18:27:26Z', 'revision_number': 1, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:38Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:27.859391 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-9bf9a52d-2751-4204-a8f3-ca46d69cfc9c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, 1cf7f705-4c7c-4525-bcfb-71db85eb96a0) {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:27.864394 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bf9a52d-2751-4204-a8f3-ca46d69cfc9c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:27.865341 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9bf9a52d-2751-4204-a8f3-ca46d69cfc9c admin admin] Publish callbacks [] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.885709 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-9bf9a52d-2751-4204-a8f3-ca46d69cfc9c admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3750837 Nov 18 18:27:27.886015 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44022) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:27.890532 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:27.895166 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8eadff6-0272-4c50-9f8f-f2015919b74f None None] Network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:27:27.898840 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03bf61ae-8a8e-4074-8823-fc0949f36a41 None None] Checking router: 9674107a-752c-42c3-a133-60c85d951af8 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:27:27.914680 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-430558', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-543'] for router, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.915878 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-430410', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-500004', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1631324', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-534'] for router, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:27.933201 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03bf61ae-8a8e-4074-8823-fc0949f36a41 None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:27.933846 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-03bf61ae-8a8e-4074-8823-fc0949f36a41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:27.974761 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:28.108208 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50af266e-121a-4049-b19a-91d90a15e699 req-5618e807-f07a-4306-ae90-9d4f228bf65f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:28.109740 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50af266e-121a-4049-b19a-91d90a15e699 req-5618e807-f07a-4306-ae90-9d4f228bf65f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f2a08e65-1c6c-43fe-a019-78643e62bd9f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2797778 Nov 18 18:27:28.123510 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:28.214082 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50af266e-121a-4049-b19a-91d90a15e699 req-3c1bb04c-5c20-45af-ada8-6018dcc48997 service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0873575 Nov 18 18:27:28.243822 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-03bf61ae-8a8e-4074-8823-fc0949f36a41 None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:28.333420 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50af266e-121a-4049-b19a-91d90a15e699 req-c24cbf16-b322-4e80-8b13-8e7a8050bcbc service neutron] 10.222.0.31 "GET /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1090109 Nov 18 18:27:28.378084 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc1c763e3-2102-51f8-97fe-c751e57774c1-1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b'}]}} from dv-cinder-787764-6-iscsi. {{(pid=102690) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 18:27:28.378947 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:28.563572 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:28.583056 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:28.607214 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.db_base_plugin_common [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Allocated IP 172.20.0.2 (1cf7f705-4c7c-4525-bcfb-71db85eb96a0/3cd0c89d-cb17-425f-b060-6f88dbc2e31b/15dd6d29-6d36-494a-b22e-ef14c2c2c5e1) {{(pid=102690) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:27:28.645429 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-03bf61ae-8a8e-4074-8823-fc0949f36a41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '36abcff2-4b6b-4296-a87c-ed3ece2c4391', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'floating_ip_address': '172.27.1.83', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '9674107a-752c-42c3-a133-60c85d951af8', 'port_id': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 533, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'mac_address': 'fa:16:3e:b7:53:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:27:14Z', 'updated_at': '2021-11-18T18:27:26Z', 'revision_number': 1, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:38Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:28.677571 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03bf61ae-8a8e-4074-8823-fc0949f36a41 None None] The sync data for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi is: [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '36abcff2-4b6b-4296-a87c-ed3ece2c4391', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'floating_ip_address': '172.27.1.83', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': '9674107a-752c-42c3-a133-60c85d951af8', 'port_id': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 533, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'mac_address': 'fa:16:3e:b7:53:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:27:14Z', 'updated_at': '2021-11-18T18:27:26Z', 'revision_number': 1, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:38Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:27:28.695553 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Allocated IP 172.27.1.143 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/8d3b49b4-83a1-4a8c-8afd-4e904bba5162) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:27:28.790440 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Publish callbacks [] for port, precommit_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:28.796581 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:28.806066 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:28.834263 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 is already hosted by enough agents. {{(pid=102690) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:27:28.837337 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.base_scheduler [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Resources bound (agent type, host, resource id): {{(pid=102690) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:28.843304 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:28.844283 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Received port after_create {{(pid=102690) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:27:28.847653 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Pushing event updated for resources: {'Port': ['ID=15dd6d29-6d36-494a-b22e-ef14c2c2c5e1,revision_number=1']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:28.887080 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:27:28.891623 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:28.894142 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:27:28.904064 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Pushing event updated for resources: {'Port': ['ID=8d3b49b4-83a1-4a8c-8afd-4e904bba5162,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:28.907614 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Attempting to bind port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:27:28.908108 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Attempting to bind port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:27:28.908573 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Attempting to bind port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 on network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:27:28.914251 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:27:28.915175 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Checking segment: {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:27:28.915175 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:28.915633 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Bound using segment: {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:27:28.916280 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Bound port: 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:27:28.917249 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:28.926143 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a351ffb0-8554-40ed-b75d-06a1a990646a None None] New status for floating IP 36abcff2-4b6b-4296-a87c-ed3ece2c4391: ACTIVE {{(pid=102691) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:27:28.986494 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] For port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:27:28.993797 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] For port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=15dd6d29-6d36-494a-b22e-ef14c2c2c5e1,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:27:28.998878 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:29.060979 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8abe97d-aef4-46b4-b0cb-5e7b833eaa4a None None] Pushing event updated for resources: {'Port': ['ID=15dd6d29-6d36-494a-b22e-ef14c2c2c5e1,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:29.172073 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:29.387495 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-430421', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-500439'] for router, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:29.517419 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Router ae4f264c-d828-44a7-ab29-e11545372d21 is scheduled to L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 with binding_index 1 {{(pid=102688) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 18:27:29.623901 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:27:29.632304 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Sync routers for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:27:29.645173 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:29.645327 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] Publish callbacks [] for router, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:29.645444 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:29.647366 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-9d1c3917-7a70-4808-9dd9-33fcfec367d7 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.7595999 Nov 18 18:27:29.649590 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44032) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:29.775274 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:29.977785 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:29Z', 'revision_number': 3, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:28Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:29.983012 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48c849a9-15bb-48bb-96da-9d6d87804639 None None] Network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:27:30.021645 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Checking router: ae4f264c-d828-44a7-ab29-e11545372d21 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:27:30.021996 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Updating router ae4f264c-d828-44a7-ab29-e11545372d21 port 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 binding host dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:27:30.080252 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.096816 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.138475 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-e513111b-0eb1-4ca6-ae22-0180bcc0c246 None None] Provisioning complete for port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:30.138854 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e513111b-0eb1-4ca6-ae22-0180bcc0c246 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.231381 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Allocated IP 172.20.0.1 (1cf7f705-4c7c-4525-bcfb-71db85eb96a0/3cd0c89d-cb17-425f-b060-6f88dbc2e31b/59ef5d7e-9855-4844-9c64-f9bd52c8d1c4) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:27:30.337696 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.373674 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.422931 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Pushing event updated for resources: {'Port': ['ID=59ef5d7e-9855-4844-9c64-f9bd52c8d1c4,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:30.431588 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:27:30.433257 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:30.435942 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:27:30.480913 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-500260'] for router_interface, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.510223 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:30.556647 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e513111b-0eb1-4ca6-ae22-0180bcc0c246 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.615949 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.623374 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-e513111b-0eb1-4ca6-ae22-0180bcc0c246 None None] For port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=15dd6d29-6d36-494a-b22e-ef14c2c2c5e1,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:30.630196 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e513111b-0eb1-4ca6-ae22-0180bcc0c246 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.668514 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:30.669097 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.752719 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Publish callbacks [] for port, precommit_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.780471 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.795975 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e513111b-0eb1-4ca6-ae22-0180bcc0c246 None None] Pushing event updated for resources: {'Port': ['ID=15dd6d29-6d36-494a-b22e-ef14c2c2c5e1,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:30.853317 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.860376 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.873981 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Attempting to bind port 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:27:30.874351 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Attempting to bind port 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:27:30.874735 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Attempting to bind port 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 on network 2cab888d-52a8-434c-814e-4f25740decd0 {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:27:30.898390 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28667f57-5883-4326-85a7-0cf82d541920 None None] Pushing event updated for resources: {'Port': ['ID=8d3b49b4-83a1-4a8c-8afd-4e904bba5162,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:30.909600 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:27:30.909600 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Checking segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:27:30.909943 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.910227 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Bound using segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:27:30.910707 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Bound port: 8d3b49b4-83a1-4a8c-8afd-4e904bba5162, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:27:30.911090 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.914492 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-be001d58-1156-4c3b-9c51-4ca336884018 None None] Provisioning complete for port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:30.914682 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-be001d58-1156-4c3b-9c51-4ca336884018 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.939537 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1772530', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-499092'] for router_interface, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:30.941708 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Pushing event updated for resources: {'Port': ['ID=59ef5d7e-9855-4844-9c64-f9bd52c8d1c4,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:31.018202 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] For port 8d3b49b4-83a1-4a8c-8afd-4e904bba5162, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:27:31.032760 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] For port 8d3b49b4-83a1-4a8c-8afd-4e904bba5162, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=8d3b49b4-83a1-4a8c-8afd-4e904bba5162,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:27:31.060666 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:31.083133 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:27:31.091180 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:31.139381 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:31.140271 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:31.177498 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28667f57-5883-4326-85a7-0cf82d541920 None None] Pushing event updated for resources: {'Port': ['ID=8d3b49b4-83a1-4a8c-8afd-4e904bba5162,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:31.237728 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Router ae4f264c-d828-44a7-ab29-e11545372d21 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:27:31.268716 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:31.300855 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-f57dc0a0-4d7d-49dc-8f95-ada9b3ac1ae3 None None] Provisioning complete for port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:31.301237 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f57dc0a0-4d7d-49dc-8f95-ada9b3ac1ae3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:31.353292 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:27:31.368483 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-3cffde61-917b-425b-8301-133090c79978 admin admin] 10.222.0.82 "PUT /v2.0/routers/ae4f264c-d828-44a7-ab29-e11545372d21/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7089899 Nov 18 18:27:31.389743 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-f57dc0a0-4d7d-49dc-8f95-ada9b3ac1ae3 None None] Port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:27:31.518587 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 2, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:31.521800 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-77be6869-b2e3-441c-b98c-14c2cc9d6a2d None None] Provisioning complete for port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:31.522116 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-77be6869-b2e3-441c-b98c-14c2cc9d6a2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:31.547882 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4965248-d137-45ac-80e3-921cea2c28e1 None None] The sync data for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi is: [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 2, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:27:31.580821 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-77be6869-b2e3-441c-b98c-14c2cc9d6a2d None None] Port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:27:31.852027 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44062) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:31.856761 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-346410515-network', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:31.882118 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Made reservation on behalf of 926cdf1bbb2149b290966b33e1def2c4 for: {'network': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:27:31.884472 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:31.893890 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:31.979433 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:31.983263 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.008601 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1300} {{(pid=102689) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:27:32.018082 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3fc7e6dd-4f23-4b01-bda1-c9bfb39faaab,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:32.024651 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.024994 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.segments_db [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Added segment e6aef544-870a-47a3-abc8-6d59806d8d81 of type vlan for network 611bc9f5-d49a-4099-912c-3333772d973c Nov 18 18:27:32.070521 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.097354 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.098452 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:32.099384 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.135696 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.2827904 Nov 18 18:27:32.138426 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44066) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:32.144405 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-f98fac39-3801-40e3-8982-0ec846dd98b8 admin admin] Request body: {'subnet': {'network_id': '611bc9f5-d49a-4099-912c-3333772d973c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-346410515-subnet', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'ip_version': 4}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:32.191736 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b763a1b2-938e-4f1c-9979-a3824405db24 admin admin] Pushing event updated for resources: {'Network': ['ID=611bc9f5-d49a-4099-912c-3333772d973c,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:32.208105 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f98fac39-3801-40e3-8982-0ec846dd98b8 admin admin] Made reservation on behalf of 926cdf1bbb2149b290966b33e1def2c4 for: {'subnet': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:27:32.210582 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f98fac39-3801-40e3-8982-0ec846dd98b8 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14479070'] for subnet, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.213926 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network 611bc9f5-d49a-4099-912c-3333772d973c details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:27:32.398721 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f98fac39-3801-40e3-8982-0ec846dd98b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-12723770', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14479088'] for subnet, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.451813 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f98fac39-3801-40e3-8982-0ec846dd98b8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:32.468426 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f98fac39-3801-40e3-8982-0ec846dd98b8 admin admin] Checking segment: {'id': 'e6aef544-870a-47a3-abc8-6d59806d8d81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1300, 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:27:32.468783 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f98fac39-3801-40e3-8982-0ec846dd98b8 admin admin] Network hostable DHCP agents. Network: 611bc9f5-d49a-4099-912c-3333772d973c, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102689) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:27:32.483395 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:27:32.486538 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:32.492677 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f98fac39-3801-40e3-8982-0ec846dd98b8 admin admin] Network 611bc9f5-d49a-4099-912c-3333772d973c is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102689) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:27:32.503249 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-f98fac39-3801-40e3-8982-0ec846dd98b8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, 611bc9f5-d49a-4099-912c-3333772d973c) {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:32.507195 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f98fac39-3801-40e3-8982-0ec846dd98b8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:32.507791 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f98fac39-3801-40e3-8982-0ec846dd98b8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.517918 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-269d2c7e-f027-4a0b-ad94-b45774099311 None None] Network 611bc9f5-d49a-4099-912c-3333772d973c requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:27:32.528452 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-f98fac39-3801-40e3-8982-0ec846dd98b8 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3888836 Nov 18 18:27:32.531625 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44070) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:32.536229 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-346410515-router', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:32.561001 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-430558', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-543'] for router, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.562103 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-430410', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-500004', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1631324', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-534'] for router, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.610255 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:32.610627 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.620890 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.735849 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc1c763e3-2102-51f8-97fe-c751e57774c1-611bc9f5-d49a-4099-912c-3333772d973c', 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'fixed_ips': [{'subnet_id': 'fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2'}]}} from dv-cinder-787764-6-iscsi. {{(pid=102690) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 18:27:32.736724 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.774570 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.777503 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.850479 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port 8d3b49b4-83a1-4a8c-8afd-4e904bba5162, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=8d3b49b4-83a1-4a8c-8afd-4e904bba5162,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:32.860653 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:32.861451 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:32.979888 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=8d3b49b4-83a1-4a8c-8afd-4e904bba5162,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:32.985367 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.db_base_plugin_common [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Allocated IP 172.20.0.2 (611bc9f5-d49a-4099-912c-3333772d973c/fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2/9ab0aab0-e172-4507-8e2d-5ac2a6883e59) {{(pid=102690) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:27:33.002826 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:33.023665 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:33.031140 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:33.031514 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:33.136291 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Allocated IP 172.27.1.130 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/f86b5f54-d766-4cb3-8202-830d3b24369a) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:27:33.213299 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Publish callbacks [] for port, precommit_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:33.218976 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587'] for port, after_create {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:33.263229 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Network 611bc9f5-d49a-4099-912c-3333772d973c is already hosted by enough agents. {{(pid=102690) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:27:33.266235 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.scheduler.base_scheduler [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Resources bound (agent type, host, resource id): {{(pid=102690) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:33.266904 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:33.268849 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Received port after_create {{(pid=102690) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:27:33.280240 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Pushing event updated for resources: {'Port': ['ID=9ab0aab0-e172-4507-8e2d-5ac2a6883e59,revision_number=1']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:33.308827 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:33.345714 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Attempting to bind port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:27:33.346395 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Attempting to bind port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': 'e6aef544-870a-47a3-abc8-6d59806d8d81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1300, 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:27:33.347123 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Attempting to bind port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 on network 611bc9f5-d49a-4099-912c-3333772d973c {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:27:33.351698 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:27:33.356174 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:33.360408 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:27:33.361818 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Checking segment: {'id': 'e6aef544-870a-47a3-abc8-6d59806d8d81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1300, 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:27:33.362200 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:33.362701 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Bound using segment: {'id': 'e6aef544-870a-47a3-abc8-6d59806d8d81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1300, 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:27:33.363230 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Bound port: 9ab0aab0-e172-4507-8e2d-5ac2a6883e59, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e6aef544-870a-47a3-abc8-6d59806d8d81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1300, 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:27:33.363568 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:27:33.363703 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:33.400207 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Pushing event updated for resources: {'Port': ['ID=f86b5f54-d766-4cb3-8202-830d3b24369a,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:33.445503 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] For port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:27:33.450183 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] For port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=9ab0aab0-e172-4507-8e2d-5ac2a6883e59,segment=NetworkSegment(e6aef544-870a-47a3-abc8-6d59806d8d81),segment_id=e6aef544-870a-47a3-abc8-6d59806d8d81)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:27:33.456798 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:33.517779 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aae638d0-49d0-4234-9b8e-cf5e56903f8c req-c85aa211-2933-4db3-9265-efbafeda1f26 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:33.519326 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aae638d0-49d0-4234-9b8e-cf5e56903f8c req-c85aa211-2933-4db3-9265-efbafeda1f26 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0699170 Nov 18 18:27:33.528507 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e2628fd-9331-4e2c-8cd7-3683be988c7e None None] Pushing event updated for resources: {'Port': ['ID=9ab0aab0-e172-4507-8e2d-5ac2a6883e59,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:33.579212 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aae638d0-49d0-4234-9b8e-cf5e56903f8c req-76f0c543-049d-41c2-b62a-f7b515daeb6c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530021 Nov 18 18:27:33.675246 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:33.806027 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Sync routers for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:27:33.818246 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:33.818940 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:33.881685 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-430421', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-500439'] for router, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:33.926198 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:33.999540 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-10128d9f-e6bf-4f34-8b0e-a7cac5e05f15 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:34.012826 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Router 1a2f271d-7fab-4f5f-a89a-e4300686f754 is scheduled to L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 with binding_index 1 {{(pid=102688) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 18:27:34.131323 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:27:34.142127 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 2, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:34.147915 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Sync routers for ids ['1a2f271d-7fab-4f5f-a89a-e4300686f754'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:27:34.155017 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] Publish callbacks [] for router, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:34.156332 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-fdca2fe5-3d76-4c9d-81ae-187c56ebdbf0 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.6236799 Nov 18 18:27:34.159120 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44090) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:34.163838 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Routers {'1a2f271d-7fab-4f5f-a89a-e4300686f754'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:34.164772 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['1a2f271d-7fab-4f5f-a89a-e4300686f754'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:34.176305 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Checking router: ae4f264c-d828-44a7-ab29-e11545372d21 for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:27:34.176669 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Updating router ae4f264c-d828-44a7-ab29-e11545372d21 port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 binding host dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:27:34.210852 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:34.487188 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Set router 1a2f271d-7fab-4f5f-a89a-e4300686f754 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:34.550446 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Publish callbacks [] for port, precommit_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:34.559009 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:34.570999 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:34.573254 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd7616e2-6df9-4d2c-96e3-2cafb112d447 None None] Network 611bc9f5-d49a-4099-912c-3333772d973c requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:27:34.623050 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Pushing event updated for resources: {'Port': ['ID=59ef5d7e-9855-4844-9c64-f9bd52c8d1c4,revision_number=3']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:34.671044 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:34.671398 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:34.671742 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:34.672379 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:34.672731 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:34.673062 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:34.673390 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:34.675113 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:34.675473 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:34.675800 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:34.678800 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:34.679207 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102691) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:27:34.699631 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Attempting to bind port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:27:34.700031 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Attempting to bind port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:27:34.700393 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Attempting to bind port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 on network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:27:34.706751 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:27:34.707122 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Checking segment: {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102691) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:27:34.707714 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:34.708148 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Bound using segment: {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:27:34.708633 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Bound port: 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'}}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:27:34.709024 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:34.798836 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] For port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102691) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:27:34.802394 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] For port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=59ef5d7e-9855-4844-9c64-f9bd52c8d1c4,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102691) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:27:34.804035 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd6248fc-f7b8-44bf-8944-b86c4b9288b4 req-9bcb1778-1b81-4946-ac02-8708afd9d1c5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:34.806448 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fd6248fc-f7b8-44bf-8944-b86c4b9288b4 req-9bcb1778-1b81-4946-ac02-8708afd9d1c5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.1111579 Nov 18 18:27:34.815196 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:34.843912 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-19175432-87e3-485b-b919-e30e77463af9 None None] Provisioning complete for port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:34.844724 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-19175432-87e3-485b-b919-e30e77463af9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:34.866991 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:34.867872 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:34.898984 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fd6248fc-f7b8-44bf-8944-b86c4b9288b4 req-6466859c-07bc-4e18-83f4-91a8a975f0d5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0856972 Nov 18 18:27:34.991439 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:34.991827 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.011774 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.020947 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'name': 'tempest-TestVolumeBootPattern-346410515-router', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130'}], 'enable_snat': True}, 'gw_port_id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:32Z', 'updated_at': '2021-11-18T18:27:33Z', 'revision_number': 3, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'gw_port': {'id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:32:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 557, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:33Z', 'updated_at': '2021-11-18T18:27:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:35.084058 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Checking router: 1a2f271d-7fab-4f5f-a89a-e4300686f754 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:27:35.084421 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Updating router 1a2f271d-7fab-4f5f-a89a-e4300686f754 port f86b5f54-d766-4cb3-8202-830d3b24369a binding host dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:27:35.093067 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-19175432-87e3-485b-b919-e30e77463af9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.107438 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68546567-fb9f-4426-aba3-6c6a30ccfa05 None None] Pushing event updated for resources: {'Port': ['ID=59ef5d7e-9855-4844-9c64-f9bd52c8d1c4,revision_number=4']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:35.138988 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:35.175581 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.214419 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_common [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Allocated IP 172.20.0.1 (611bc9f5-d49a-4099-912c-3333772d973c/fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2/f9457714-1f9d-4edc-b7d1-f887e78aae31) {{(pid=102688) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:27:35.226075 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-19175432-87e3-485b-b919-e30e77463af9 None None] For port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=9ab0aab0-e172-4507-8e2d-5ac2a6883e59,segment=NetworkSegment(e6aef544-870a-47a3-abc8-6d59806d8d81),segment_id=e6aef544-870a-47a3-abc8-6d59806d8d81)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:35.241335 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-19175432-87e3-485b-b919-e30e77463af9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.327426 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Publish callbacks [] for port, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.361789 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:34Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:35.367648 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.393581 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9c561c2-0fb5-4f1f-9a1d-fc33ca4f3f40 None None] The sync data for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi is: [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:34Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:27:35.401816 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:35.411274 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Network 611bc9f5-d49a-4099-912c-3333772d973c is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:27:35.414399 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:35.418167 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Received port after_create {{(pid=102688) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:27:35.436161 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19175432-87e3-485b-b919-e30e77463af9 None None] Pushing event updated for resources: {'Port': ['ID=9ab0aab0-e172-4507-8e2d-5ac2a6883e59,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:35.449309 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Pushing event updated for resources: {'Port': ['ID=f9457714-1f9d-4edc-b7d1-f887e78aae31,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:35.459480 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-468364cd-7d17-48c4-a192-af4761c61a69 None None] Provisioning complete for port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:35.459868 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-468364cd-7d17-48c4-a192-af4761c61a69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.467890 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-500260'] for router_interface, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.598030 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:35.598605 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.626922 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.712615 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-468364cd-7d17-48c4-a192-af4761c61a69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.744952 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Publish callbacks [] for port, precommit_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.789848 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.811289 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-468364cd-7d17-48c4-a192-af4761c61a69 None None] For port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=59ef5d7e-9855-4844-9c64-f9bd52c8d1c4,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:35.834662 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Publish callbacks [] for port, precommit_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.841202 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-13993110'] for port, after_update {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.847204 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-468364cd-7d17-48c4-a192-af4761c61a69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.874626 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Attempting to bind port f86b5f54-d766-4cb3-8202-830d3b24369a on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:27:35.874994 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Attempting to bind port f86b5f54-d766-4cb3-8202-830d3b24369a by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:27:35.875357 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Attempting to bind port f86b5f54-d766-4cb3-8202-830d3b24369a on network 2cab888d-52a8-434c-814e-4f25740decd0 {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:27:35.885120 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08e25d93-bc9d-4060-b1ad-caaf2afde8bb None None] Pushing event updated for resources: {'Port': ['ID=f86b5f54-d766-4cb3-8202-830d3b24369a,revision_number=2']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:35.890603 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:27:35.890986 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Checking segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102690) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:27:35.891535 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.891775 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Bound using segment: {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'} {{(pid=102690) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:27:35.892290 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.managers [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Bound port: f86b5f54-d766-4cb3-8202-830d3b24369a, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '94f1c6ed-c97a-45f3-94c4-d04f9231084d', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0'}}] {{(pid=102690) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:27:35.892655 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.916773 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Pushing event updated for resources: {'Port': ['ID=f9457714-1f9d-4edc-b7d1-f887e78aae31,revision_number=2']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:35.921991 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1772530', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-499092'] for router_interface, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:35.988801 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] For port f86b5f54-d766-4cb3-8202-830d3b24369a, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102690) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:27:36.021901 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-92403cbf-bacf-4593-8c6c-59fd28f15c87 None None] Provisioning complete for port f9457714-1f9d-4edc-b7d1-f887e78aae31 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:36.022485 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-92403cbf-bacf-4593-8c6c-59fd28f15c87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:36.025347 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] For port f86b5f54-d766-4cb3-8202-830d3b24369a, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=f86b5f54-d766-4cb3-8202-830d3b24369a,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:27:36.028369 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-468364cd-7d17-48c4-a192-af4761c61a69 None None] Pushing event updated for resources: {'Port': ['ID=59ef5d7e-9855-4844-9c64-f9bd52c8d1c4,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:36.034795 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Network 611bc9f5-d49a-4099-912c-3333772d973c is already hosted by enough agents. {{(pid=102688) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:27:36.036827 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Resources bound (agent type, host, resource id): {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:36.051774 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:36.084724 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff2bfca6-0bdc-4ad9-a0b1-c4bb1cb58633 req-06f40df6-580b-4ba5-8483-df5c9538b29c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:36.086290 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ff2bfca6-0bdc-4ad9-a0b1-c4bb1cb58633 req-06f40df6-580b-4ba5-8483-df5c9538b29c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0941637 Nov 18 18:27:36.120524 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-92403cbf-bacf-4593-8c6c-59fd28f15c87 None None] Port f9457714-1f9d-4edc-b7d1-f887e78aae31 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:27:36.141881 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Routers {'1a2f271d-7fab-4f5f-a89a-e4300686f754'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:36.142518 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['1a2f271d-7fab-4f5f-a89a-e4300686f754'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:36.176271 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ff2bfca6-0bdc-4ad9-a0b1-c4bb1cb58633 req-becb91cc-fd64-4f7f-b493-bf8e6878ca7c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0748906 Nov 18 18:27:36.207951 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Router 1a2f271d-7fab-4f5f-a89a-e4300686f754 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102688) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:27:36.217061 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-92403cbf-bacf-4593-8c6c-59fd28f15c87 None None] Provisioning complete for port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:36.217427 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-92403cbf-bacf-4593-8c6c-59fd28f15c87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:36.221755 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08e25d93-bc9d-4060-b1ad-caaf2afde8bb None None] Pushing event updated for resources: {'Port': ['ID=f86b5f54-d766-4cb3-8202-830d3b24369a,revision_number=3']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:36.329947 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:27:36.345216 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-1951d3e3-9e3d-46dc-9476-fbc9945176ff admin admin] 10.222.0.82 "PUT /v2.0/routers/1a2f271d-7fab-4f5f-a89a-e4300686f754/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1848702 Nov 18 18:27:36.400853 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] Set router 1a2f271d-7fab-4f5f-a89a-e4300686f754 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:36.455439 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-0e4ef31f-21fb-4891-ae33-56b85bb990aa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:36.617422 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:36.709813 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-fc544d2e-a228-439c-b8e7-4e557f2c734a None None] Provisioning complete for port f9457714-1f9d-4edc-b7d1-f887e78aae31 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:36.710080 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-fc544d2e-a228-439c-b8e7-4e557f2c734a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:36.789609 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-fc544d2e-a228-439c-b8e7-4e557f2c734a None None] Port f9457714-1f9d-4edc-b7d1-f887e78aae31 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:27:36.793777 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:36.794143 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:36.857538 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'name': 'tempest-TestVolumeBootPattern-346410515-router', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130'}], 'enable_snat': True}, 'gw_port_id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:32Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 4, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'gw_port': {'id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:32:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 557, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:33Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'f9457714-1f9d-4edc-b7d1-f887e78aae31', 'name': '', 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'mac_address': 'fa:16:3e:7e:96:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'device_owner': 'network:router_interface', 'standard_attr_id': 558, 'fixed_ips': [{'subnet_id': 'fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:35Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 2, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'subnets': [{'id': 'fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:36.899365 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04629aa2-fd36-4f16-8639-5e46e3171825 None None] The sync data for ids ['1a2f271d-7fab-4f5f-a89a-e4300686f754'] in dv-cinder-787764-6-iscsi is: [{'id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'name': 'tempest-TestVolumeBootPattern-346410515-router', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130'}], 'enable_snat': True}, 'gw_port_id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:32Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 4, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'gw_port': {'id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:32:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 557, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:33Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'f9457714-1f9d-4edc-b7d1-f887e78aae31', 'name': '', 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'mac_address': 'fa:16:3e:7e:96:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'device_owner': 'network:router_interface', 'standard_attr_id': 558, 'fixed_ips': [{'subnet_id': 'fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:35Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 2, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'subnets': [{'id': 'fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:27:36.912775 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:36.968366 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:36.968740 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:36.983108 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44106) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:36.988661 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-586eb442-7798-4b07-a4ce-91c271e95dbf tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1203552063', 'description': 'tempest-secgroup-smoke-1203552063 description', 'project_id': 'd08a29a317934e72a71b69340d23cd0b'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:37.011577 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-586eb442-7798-4b07-a4ce-91c271e95dbf tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.083077 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-586eb442-7798-4b07-a4ce-91c271e95dbf tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.087676 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-586eb442-7798-4b07-a4ce-91c271e95dbf tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.135271 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-586eb442-7798-4b07-a4ce-91c271e95dbf tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.136562 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-586eb442-7798-4b07-a4ce-91c271e95dbf tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1524384 Nov 18 18:27:37.139657 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44108) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:37.142085 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-586eb442-7798-4b07-a4ce-91c271e95dbf tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'SecurityGroup': ['ID=dd44e10b-bbd9-463d-98f3-ddfd17eace36,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:37.146498 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-84d7e565-ba82-441f-9a0f-29892b2f2cc6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'security_group_rule': {'security_group_id': 'dd44e10b-bbd9-463d-98f3-ddfd17eace36', 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:37.176024 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-84d7e565-ba82-441f-9a0f-29892b2f2cc6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.228549 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-84d7e565-ba82-441f-9a0f-29892b2f2cc6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.233135 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-84d7e565-ba82-441f-9a0f-29892b2f2cc6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.252850 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d7e565-ba82-441f-9a0f-29892b2f2cc6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a6a03685-5c20-43a4-a6cc-0c945a5d73b3,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:37.258698 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-84d7e565-ba82-441f-9a0f-29892b2f2cc6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.260277 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-84d7e565-ba82-441f-9a0f-29892b2f2cc6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1183770 Nov 18 18:27:37.262600 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44112) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:37.267425 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-26569e66-6460-42d7-b7d5-10a988b2ba44 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'security_group_rule': {'security_group_id': 'dd44e10b-bbd9-463d-98f3-ddfd17eace36', 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:37.325869 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-26569e66-6460-42d7-b7d5-10a988b2ba44 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.345266 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd5aacaa-8f64-49c4-add9-39b267f60624 req-0da98db2-d56f-489d-87e5-cd9d2200ea58 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:37.347083 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fd5aacaa-8f64-49c4-add9-39b267f60624 req-0da98db2-d56f-489d-87e5-cd9d2200ea58 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0751548 Nov 18 18:27:37.426209 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fd5aacaa-8f64-49c4-add9-39b267f60624 req-2dc17daa-d538-48b1-870c-141c183f708d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0725331 Nov 18 18:27:37.427750 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-26569e66-6460-42d7-b7d5-10a988b2ba44 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.431236 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-26569e66-6460-42d7-b7d5-10a988b2ba44 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.455362 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26569e66-6460-42d7-b7d5-10a988b2ba44 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0f63176c-ecda-44ab-8d2d-c23030f8a312,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:37.459261 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-26569e66-6460-42d7-b7d5-10a988b2ba44 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.460477 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-26569e66-6460-42d7-b7d5-10a988b2ba44 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1967649 Nov 18 18:27:37.464110 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44116) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:37.468473 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-6e07c2e9-33e5-4155-9682-19e520628a3c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'security_group_rule': {'security_group_id': 'dd44e10b-bbd9-463d-98f3-ddfd17eace36', 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:37.494152 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6e07c2e9-33e5-4155-9682-19e520628a3c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.550606 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6e07c2e9-33e5-4155-9682-19e520628a3c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.553866 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6e07c2e9-33e5-4155-9682-19e520628a3c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.571700 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e07c2e9-33e5-4155-9682-19e520628a3c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=36e0968b-d3bf-4f8f-aeca-49fc1646070e,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:37.576626 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6e07c2e9-33e5-4155-9682-19e520628a3c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.577827 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-6e07c2e9-33e5-4155-9682-19e520628a3c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1127083 Nov 18 18:27:37.580511 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44118) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:37.584601 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-7ffb6af9-0ca3-49ee-805d-9e95d5d9ae8b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'security_group_rule': {'security_group_id': 'dd44e10b-bbd9-463d-98f3-ddfd17eace36', 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:37.609302 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7ffb6af9-0ca3-49ee-805d-9e95d5d9ae8b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.662656 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7ffb6af9-0ca3-49ee-805d-9e95d5d9ae8b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.665892 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7ffb6af9-0ca3-49ee-805d-9e95d5d9ae8b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.682868 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ffb6af9-0ca3-49ee-805d-9e95d5d9ae8b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7feecadd-3507-449c-bf1c-d844cb9f0406,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:37.691066 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7ffb6af9-0ca3-49ee-805d-9e95d5d9ae8b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.692268 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-7ffb6af9-0ca3-49ee-805d-9e95d5d9ae8b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1108334 Nov 18 18:27:37.694992 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44120) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:37.699619 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-dcfdc385-85cc-47e0-8653-2ccf5941d254 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'security_group_rule': {'security_group_id': 'dd44e10b-bbd9-463d-98f3-ddfd17eace36', 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:37.719363 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.722185 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.securitygroups_db [None req-dcfdc385-85cc-47e0-8653-2ccf5941d254 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Project d08a29a317934e72a71b69340d23cd0b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 18 18:27:37.726902 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dcfdc385-85cc-47e0-8653-2ccf5941d254 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.785105 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dcfdc385-85cc-47e0-8653-2ccf5941d254 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.788346 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dcfdc385-85cc-47e0-8653-2ccf5941d254 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.805357 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcfdc385-85cc-47e0-8653-2ccf5941d254 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=740b237a-d4f4-4d2e-bdba-23628cce764c,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:37.813061 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dcfdc385-85cc-47e0-8653-2ccf5941d254 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.814555 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-dcfdc385-85cc-47e0-8653-2ccf5941d254 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1183469 Nov 18 18:27:37.816982 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44122) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:27:37.821179 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-7543f716-ef80-4354-bb1d-d3b08364dd58 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'security_group_rule': {'security_group_id': 'dd44e10b-bbd9-463d-98f3-ddfd17eace36', 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:37.841853 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.securitygroups_db [None req-7543f716-ef80-4354-bb1d-d3b08364dd58 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Project d08a29a317934e72a71b69340d23cd0b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 18 18:27:37.846949 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7543f716-ef80-4354-bb1d-d3b08364dd58 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.903877 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7543f716-ef80-4354-bb1d-d3b08364dd58 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.907448 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7543f716-ef80-4354-bb1d-d3b08364dd58 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678246'] for security_group_rule, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.925798 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7543f716-ef80-4354-bb1d-d3b08364dd58 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7708c48d-67c8-4843-918d-471611d8e1f3,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:37.931294 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7543f716-ef80-4354-bb1d-d3b08364dd58 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:37.932413 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-7543f716-ef80-4354-bb1d-d3b08364dd58 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1145179 Nov 18 18:27:38.570371 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-669f4221-9b2a-4aa6-a663-05f1d5263e9c req-001e7b5b-57b5-4072-b200-6648c32fc00e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:38.572086 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-669f4221-9b2a-4aa6-a663-05f1d5263e9c req-001e7b5b-57b5-4072-b200-6648c32fc00e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0538471 Nov 18 18:27:38.627361 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-669f4221-9b2a-4aa6-a663-05f1d5263e9c req-67431c27-7785-4d43-a153-0053068b45d0 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483572 Nov 18 18:27:39.058287 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:39.711212 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Sync routers for ids ['1a2f271d-7fab-4f5f-a89a-e4300686f754'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:27:39.723440 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Routers {'1a2f271d-7fab-4f5f-a89a-e4300686f754'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:39.724203 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['1a2f271d-7fab-4f5f-a89a-e4300686f754'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:39.746859 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65f8054e-233c-4940-8558-e725e21569c9 req-4227b976-2433-4dde-b4ca-08039dcfe023 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:39.748388 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65f8054e-233c-4940-8558-e725e21569c9 req-4227b976-2433-4dde-b4ca-08039dcfe023 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0494967 Nov 18 18:27:39.795064 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65f8054e-233c-4940-8558-e725e21569c9 req-1840255e-df54-461d-a4fd-035a0355eaa1 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406387 Nov 18 18:27:39.830975 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Set router 1a2f271d-7fab-4f5f-a89a-e4300686f754 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:40.025169 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'name': 'tempest-TestVolumeBootPattern-346410515-router', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130'}], 'enable_snat': True}, 'gw_port_id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:32Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 4, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'gw_port': {'id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:32:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 557, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:33Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'f9457714-1f9d-4edc-b7d1-f887e78aae31', 'name': '', 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'mac_address': 'fa:16:3e:7e:96:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'device_owner': 'network:router_interface', 'standard_attr_id': 558, 'fixed_ips': [{'subnet_id': 'fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:35Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 2, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'subnets': [{'id': 'fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:40.055430 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Checking router: 1a2f271d-7fab-4f5f-a89a-e4300686f754 for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:27:40.055774 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Updating router 1a2f271d-7fab-4f5f-a89a-e4300686f754 port f9457714-1f9d-4edc-b7d1-f887e78aae31 binding host dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 18:27:40.079185 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.181865 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.342352 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Publish callbacks [] for port, precommit_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.348077 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.404333 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8467a3fa-b694-4f63-a0d0-3a6d29aa848b None None] Pushing event updated for resources: {'Port': ['ID=f9457714-1f9d-4edc-b7d1-f887e78aae31,revision_number=3']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:40.430411 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device f86b5f54-d766-4cb3-8202-830d3b24369a up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:40.470916 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Attempting to bind port f9457714-1f9d-4edc-b7d1-f887e78aae31 on host dv-cinder-787764-6-iscsi for vnic_type normal with profile {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:27:40.471273 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Attempting to bind port f9457714-1f9d-4edc-b7d1-f887e78aae31 by drivers openvswitch,hyperv on host dv-cinder-787764-6-iscsi at level 0 using segments [{'id': 'e6aef544-870a-47a3-abc8-6d59806d8d81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1300, 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c'}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:27:40.471631 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Attempting to bind port f9457714-1f9d-4edc-b7d1-f887e78aae31 on network 611bc9f5-d49a-4099-912c-3333772d973c {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:27:40.477337 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Checking agent: {'id': '0c09e170-1d7e-4fc1-9c50-08c31c35a6c3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787764-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 13, 40), 'started_at': datetime.datetime(2021, 11, 18, 18, 14, 10), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 27, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787764-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:27:40.477705 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Checking segment: {'id': 'e6aef544-870a-47a3-abc8-6d59806d8d81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1300, 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102691) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:27:40.478581 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.478581 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Bound using segment: {'id': 'e6aef544-870a-47a3-abc8-6d59806d8d81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1300, 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c'} {{(pid=102691) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:27:40.479492 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.managers [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Bound port: f9457714-1f9d-4edc-b7d1-f887e78aae31, host: dv-cinder-787764-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e6aef544-870a-47a3-abc8-6d59806d8d81', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1300, 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c'}}] {{(pid=102691) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:27:40.479882 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.501576 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port f86b5f54-d766-4cb3-8202-830d3b24369a triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:40.501954 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.545095 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] For port f9457714-1f9d-4edc-b7d1-f887e78aae31, host dv-cinder-787764-6-iscsi, cleared binding levels {{(pid=102691) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:27:40.548811 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.plugins.ml2.db [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] For port f9457714-1f9d-4edc-b7d1-f887e78aae31, host dv-cinder-787764-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=f9457714-1f9d-4edc-b7d1-f887e78aae31,segment=NetworkSegment(e6aef544-870a-47a3-abc8-6d59806d8d81),segment_id=e6aef544-870a-47a3-abc8-6d59806d8d81)] {{(pid=102691) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:27:40.553307 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron_lib.callbacks.manager [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102691) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.587795 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.611439 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] For port f86b5f54-d766-4cb3-8202-830d3b24369a, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=f86b5f54-d766-4cb3-8202-830d3b24369a,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:40.612489 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8467a3fa-b694-4f63-a0d0-3a6d29aa848b None None] Pushing event updated for resources: {'Port': ['ID=f9457714-1f9d-4edc-b7d1-f887e78aae31,revision_number=4']} {{(pid=102691) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:40.616332 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.622067 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Routers {'1a2f271d-7fab-4f5f-a89a-e4300686f754'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:27:40.622722 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:27:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['1a2f271d-7fab-4f5f-a89a-e4300686f754'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:40.690491 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Pushing event updated for resources: {'Port': ['ID=f86b5f54-d766-4cb3-8202-830d3b24369a,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:40.701690 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-af67b0b0-2da3-4b21-962d-8d4f1d30c0f5 None None] Provisioning complete for port f9457714-1f9d-4edc-b7d1-f887e78aae31 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:40.702351 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-af67b0b0-2da3-4b21-962d-8d4f1d30c0f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.783744 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] Set router 1a2f271d-7fab-4f5f-a89a-e4300686f754 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:27:40.805720 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-af67b0b0-2da3-4b21-962d-8d4f1d30c0f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.841967 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-af67b0b0-2da3-4b21-962d-8d4f1d30c0f5 None None] For port f9457714-1f9d-4edc-b7d1-f887e78aae31, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=f9457714-1f9d-4edc-b7d1-f887e78aae31,segment=NetworkSegment(e6aef544-870a-47a3-abc8-6d59806d8d81),segment_id=e6aef544-870a-47a3-abc8-6d59806d8d81)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:40.847334 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-af67b0b0-2da3-4b21-962d-8d4f1d30c0f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.901519 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af67b0b0-2da3-4b21-962d-8d4f1d30c0f5 None None] Pushing event updated for resources: {'Port': ['ID=f9457714-1f9d-4edc-b7d1-f887e78aae31,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:40.926859 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97574f45-c1ad-48d3-9dfc-f2703fbe0d89 req-82be8124-8989-4a7f-9f70-f0f9ae5373de tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:40.928551 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-97574f45-c1ad-48d3-9dfc-f2703fbe0d89 req-82be8124-8989-4a7f-9f70-f0f9ae5373de tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0485091 Nov 18 18:27:40.971370 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-bebe4188-896a-4483-880c-946402ac6127 None None] Provisioning complete for port f9457714-1f9d-4edc-b7d1-f887e78aae31 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:40.971882 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bebe4188-896a-4483-880c-946402ac6127 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:40.979083 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-97574f45-c1ad-48d3-9dfc-f2703fbe0d89 req-862eb515-6512-4739-af08-62b57d44e7ab tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441015 Nov 18 18:27:41.003346 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'name': 'tempest-TestVolumeBootPattern-346410515-router', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130'}], 'enable_snat': True}, 'gw_port_id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:32Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 4, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'gw_port': {'id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:32:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 557, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:33Z', 'updated_at': '2021-11-18T18:27:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'f9457714-1f9d-4edc-b7d1-f887e78aae31', 'name': '', 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'mac_address': 'fa:16:3e:7e:96:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'device_owner': 'network:router_interface', 'standard_attr_id': 558, 'fixed_ips': [{'subnet_id': 'fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:35Z', 'updated_at': '2021-11-18T18:27:40Z', 'revision_number': 4, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'subnets': [{'id': 'fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:27:41.031203 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a03c725e-8b9b-429a-b999-31b856c67079 None None] The sync data for ids ['1a2f271d-7fab-4f5f-a89a-e4300686f754'] in dv-cinder-787764-6-iscsi is: [{'id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'name': 'tempest-TestVolumeBootPattern-346410515-router', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130'}], 'enable_snat': True}, 'gw_port_id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:32Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 4, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'gw_port': {'id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:32:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 557, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:33Z', 'updated_at': '2021-11-18T18:27:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': 'f9457714-1f9d-4edc-b7d1-f887e78aae31', 'name': '', 'network_id': '611bc9f5-d49a-4099-912c-3333772d973c', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'mac_address': 'fa:16:3e:7e:96:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'device_owner': 'network:router_interface', 'standard_attr_id': 558, 'fixed_ips': [{'subnet_id': 'fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:35Z', 'updated_at': '2021-11-18T18:27:40Z', 'revision_number': 4, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'subnets': [{'id': 'fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:27:42.104127 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4aa02d2-aa8e-43a2-9c41-550f4176bf91 req-608a91c7-0160-4783-a978-c090a2bb6e6a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:42.106150 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d4aa02d2-aa8e-43a2-9c41-550f4176bf91 req-608a91c7-0160-4783-a978-c090a2bb6e6a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0516260 Nov 18 18:27:42.154148 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d4aa02d2-aa8e-43a2-9c41-550f4176bf91 req-eb20bdde-dbdb-4a27-a0c1-21c0d36eed75 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402048 Nov 18 18:27:42.422222 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device f86b5f54-d766-4cb3-8202-830d3b24369a up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:42.471076 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port f86b5f54-d766-4cb3-8202-830d3b24369a triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:42.471450 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:42.550951 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device f9457714-1f9d-4edc-b7d1-f887e78aae31 up at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:42.598147 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Provisioning complete for port f9457714-1f9d-4edc-b7d1-f887e78aae31 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:42.598461 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:43.274361 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f363c44-d207-45c8-a0ca-afc8caa2dc80 req-11b6e34b-36f3-45ef-ad69-06bcb86abbbc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:43.275797 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3f363c44-d207-45c8-a0ca-afc8caa2dc80 req-11b6e34b-36f3-45ef-ad69-06bcb86abbbc tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0470474 Nov 18 18:27:43.322821 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3f363c44-d207-45c8-a0ca-afc8caa2dc80 req-bc615208-cfa7-479a-8623-5c9245e97706 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411634 Nov 18 18:27:44.442778 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fc4bf2-23a6-45e3-80c8-4d58d455b95a req-9b9a391d-1e66-48bd-8a08-670808b182f2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:44.444276 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c8fc4bf2-23a6-45e3-80c8-4d58d455b95a req-9b9a391d-1e66-48bd-8a08-670808b182f2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0483215 Nov 18 18:27:44.496842 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c8fc4bf2-23a6-45e3-80c8-4d58d455b95a req-bd020b42-2cba-4491-8dfd-8240d660559d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454643 Nov 18 18:27:45.615005 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fad2e7bd-edda-4082-a3fe-4b809911cfe0 req-5108f12c-d8c4-4727-9a00-32618642206c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:45.616531 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fad2e7bd-edda-4082-a3fe-4b809911cfe0 req-5108f12c-d8c4-4727-9a00-32618642206c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0486214 Nov 18 18:27:45.663448 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fad2e7bd-edda-4082-a3fe-4b809911cfe0 req-873f954e-5915-40b3-9a3d-a15860d2e00b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405009 Nov 18 18:27:46.784884 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8de231-6a44-4b44-8960-69a26a867941 req-aa22e336-bc2a-43d7-8110-a7e2b7872f81 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:46.786359 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8b8de231-6a44-4b44-8960-69a26a867941 req-aa22e336-bc2a-43d7-8110-a7e2b7872f81 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0481970 Nov 18 18:27:46.833002 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8b8de231-6a44-4b44-8960-69a26a867941 req-4b8f1fd7-c16a-4999-a025-5a6e682d4341 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399933 Nov 18 18:27:47.954173 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57032037-655b-4eec-a59f-c55ac8276ae7 req-d235bd52-204e-4930-a0cf-a4df32650739 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:47.955551 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-57032037-655b-4eec-a59f-c55ac8276ae7 req-d235bd52-204e-4930-a0cf-a4df32650739 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0509274 Nov 18 18:27:48.002808 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-57032037-655b-4eec-a59f-c55ac8276ae7 req-cd166692-2c21-4145-b9a9-bb80d1b97c90 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413508 Nov 18 18:27:49.121187 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a67a40b-c754-4bd8-99cb-c64b17adc28c req-8dfc8780-7352-4e7a-819c-602bdaf4f181 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:49.122638 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5a67a40b-c754-4bd8-99cb-c64b17adc28c req-8dfc8780-7352-4e7a-819c-602bdaf4f181 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0504801 Nov 18 18:27:49.168940 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5a67a40b-c754-4bd8-99cb-c64b17adc28c req-800ad610-b5a6-4b12-9906-38e6870b9094 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402002 Nov 18 18:27:50.296566 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d13814-4e0b-419a-964a-3295570ad1e1 req-630d11c9-3626-4385-ad18-218872553e78 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:50.298030 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d7d13814-4e0b-419a-964a-3295570ad1e1 req-630d11c9-3626-4385-ad18-218872553e78 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0555310 Nov 18 18:27:50.349269 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d7d13814-4e0b-419a-964a-3295570ad1e1 req-b6435ec4-f72a-401b-95b7-248c1164e2e5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452363 Nov 18 18:27:50.457737 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 02e0aac7-3022-49e1-8484-d2e56545e298 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:27:50.556253 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=02e0aac7-3022-49e1-8484-d2e56545e298,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:50.567346 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '02e0aac7-3022-49e1-8484-d2e56545e298', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'port_id': '02e0aac7-3022-49e1-8484-d2e56545e298', 'mac_address': 'fa:16:3e:bb:bc:02', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1342, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:27:50.605144 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:50.618098 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 02e0aac7-3022-49e1-8484-d2e56545e298 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:27:50.639259 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=02e0aac7-3022-49e1-8484-d2e56545e298,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:50.643565 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:50.694369 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=02e0aac7-3022-49e1-8484-d2e56545e298,revision_number=6']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:50.751363 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['02e0aac7-3022-49e1-8484-d2e56545e298'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:27:51.140655 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:51.467385 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c154566-41b8-4917-a4e2-d27c69cf3e9e req-3740574c-9dc3-459a-9b82-e0f84e4b0ca0 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:51.468922 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c154566-41b8-4917-a4e2-d27c69cf3e9e req-3740574c-9dc3-459a-9b82-e0f84e4b0ca0 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 944 time: 0.0489252 Nov 18 18:27:51.517342 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0c154566-41b8-4917-a4e2-d27c69cf3e9e req-3de379ce-27bf-4496-86d1-1196259dd6e5 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422797 Nov 18 18:27:52.458502 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 02e0aac7-3022-49e1-8484-d2e56545e298 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:27:52.509408 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 02e0aac7-3022-49e1-8484-d2e56545e298 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:52.510249 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:52.609421 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:52.643746 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60359e72-a772-4740-be8f-143d13d90bb6 req-60d62679-3337-476b-8062-a4cab00e3800 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:52.649700 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=02e0aac7-3022-49e1-8484-d2e56545e298,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:27:52.651492 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:27:52.652254 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-60359e72-a772-4740-be8f-143d13d90bb6 req-60d62679-3337-476b-8062-a4cab00e3800 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 944 time: 0.0576236 Nov 18 18:27:52.654031 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6161ebe7-f226-4d93-a701-33b0d77de3cc" -d '{"events": [{"server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "name": "network-vif-plugged", "status": "completed", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:27:52.658159 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:52.711366 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:27:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b477762-31b3-41bc-bc67-a7b5ea5dd517 x-openstack-request-id: req-6b477762-31b3-41bc-bc67-a7b5ea5dd517 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:27:52.711707 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "name": "network-vif-plugged", "status": "completed", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:27:52.711990 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-6b477762-31b3-41bc-bc67-a7b5ea5dd517 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:27:52.712381 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298', 'code': 200} Nov 18 18:27:52.716272 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-60359e72-a772-4740-be8f-143d13d90bb6 req-c3ab1f3a-d99a-4a33-b11a-2a9412998a67 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0582843 Nov 18 18:27:52.717748 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=02e0aac7-3022-49e1-8484-d2e56545e298,revision_number=7']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:53.837098 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08811e01-5366-43f6-8aa8-2dadb541fb62 req-adc6cc86-a548-4178-aa23-0a70e1222f67 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:53.838649 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-08811e01-5366-43f6-8aa8-2dadb541fb62 req-adc6cc86-a548-4178-aa23-0a70e1222f67 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0493891 Nov 18 18:27:53.894329 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-08811e01-5366-43f6-8aa8-2dadb541fb62 req-db8ee913-e0e3-4862-a2be-7705b99a12e2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496461 Nov 18 18:27:55.005885 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68642376-6ddf-4b57-bd77-93842e39a961 req-12772585-8af1-464f-a15a-90bb8f878a40 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:55.007491 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-68642376-6ddf-4b57-bd77-93842e39a961 req-12772585-8af1-464f-a15a-90bb8f878a40 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0482719 Nov 18 18:27:55.054295 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-68642376-6ddf-4b57-bd77-93842e39a961 req-2b51f0c6-291e-4c4f-bb24-bd0e37aeaf92 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409048 Nov 18 18:27:56.201882 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5fe0906-2198-4b23-a2c0-df1ddcea667b req-eac8643e-3ed7-4832-b1cc-cbaae3cde20e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:56.209469 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b5fe0906-2198-4b23-a2c0-df1ddcea667b req-eac8643e-3ed7-4832-b1cc-cbaae3cde20e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0807884 Nov 18 18:27:56.270074 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b5fe0906-2198-4b23-a2c0-df1ddcea667b req-d7c83f41-4e02-4e86-863e-3064feb88ff7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0588686 Nov 18 18:27:56.493052 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-6b61659e-5c94-4770-8aa1-8faaabf61a41 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1203552063&fields=id&tenant_id=d08a29a317934e72a71b69340d23cd0b HTTP/1.1" status: 200 len: 267 time: 0.0638602 Nov 18 18:27:56.614700 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-14c8386d-2a6a-4efe-96d0-cd02b2afdb71 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:56.616424 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-14c8386d-2a6a-4efe-96d0-cd02b2afdb71 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 811 time: 0.1156311 Nov 18 18:27:56.640515 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-ce36c5e6-12d9-491f-b370-b04836fc7bd0 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/quotas/d08a29a317934e72a71b69340d23cd0b HTTP/1.1" status: 200 len: 375 time: 0.0157299 Nov 18 18:27:56.700503 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-54c3ecd5-cd18-4cb7-88ea-c6f5dab2967e tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0587966 Nov 18 18:27:56.806957 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-15ca9c9c-897f-442a-8772-6ba14878403d service neutron] 10.222.0.82 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0936899 Nov 18 18:27:56.918390 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-bacbcffa-c0d6-4e98-84c6-317e3961636a service neutron] 10.222.0.82 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1046562 Nov 18 18:27:57.246334 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1322d915-352d-47a3-89bb-0dd1be99a253 req-7defe9e7-e2e7-4e42-bfc8-dc1c38292f56 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 210 time: 0.0425549 Nov 18 18:27:57.421406 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f77e92-1437-43df-97f5-0bbbe8e4d068 req-3699b11a-895a-4a46-bf54-154ed48d514c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:57.422975 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d7f77e92-1437-43df-97f5-0bbbe8e4d068 req-3699b11a-895a-4a46-bf54-154ed48d514c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0633559 Nov 18 18:27:57.496426 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d7f77e92-1437-43df-97f5-0bbbe8e4d068 req-87e94d82-267f-4fa5-8c41-82e911a9df99 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0658231 Nov 18 18:27:58.464988 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f929f187-5a2b-4618-8519-a1418ce810fa req-d6466944-c461-4931-bfd9-4414d7a1f875 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 210 time: 0.1127243 Nov 18 18:27:58.486824 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-74b4fcf8-2a23-4ce0-bd45-6ebb292e2e28 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:58.489046 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-74b4fcf8-2a23-4ce0-bd45-6ebb292e2e28 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 811 time: 0.1923027 Nov 18 18:27:58.603838 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-2536cd87-89fe-488e-9e8a-77afae760c4b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d08a29a317934e72a71b69340d23cd0b HTTP/1.1" status: 200 len: 380 time: 0.0977638 Nov 18 18:27:58.614924 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'port': {'device_id': '024f682c-8986-4663-a691-45b3b44d7add', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'admin_state_up': True, 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'security_groups': ['dd44e10b-bbd9-463d-98f3-ddfd17eace36']}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:58.755239 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00c24b7c-ab37-4984-98f9-b5d0f7619c47 req-cd2b49d2-9ee8-4115-9890-affe2f5b7fb3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:58.762069 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-00c24b7c-ab37-4984-98f9-b5d0f7619c47 req-cd2b49d2-9ee8-4115-9890-affe2f5b7fb3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.1374974 Nov 18 18:27:58.848567 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Made reservation on behalf of d08a29a317934e72a71b69340d23cd0b for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:27:58.852295 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:58.859853 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-00c24b7c-ab37-4984-98f9-b5d0f7619c47 req-6400c59a-2610-4b2c-acd5-def01fd3667d tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0793025 Nov 18 18:27:59.023559 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Allocated IP 172.20.0.12 (1cf7f705-4c7c-4525-bcfb-71db85eb96a0/3cd0c89d-cb17-425f-b060-6f88dbc2e31b/ccea3eb1-d1c4-4326-b70b-95e79feb632e) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:27:59.179156 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:59.217751 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:59.263918 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:27:59.267167 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:27:59.273895 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:27:59.277886 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'Port': ['ID=ccea3eb1-d1c4-4326-b70b-95e79feb632e,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:27:59.339668 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:59.340694 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:59.363857 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-278b728a-1fc7-4214-b19c-18d4f286c4e6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7529509 Nov 18 18:27:59.379003 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Request body: {'port': {'device_id': '024f682c-8986-4663-a691-45b3b44d7add', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:27:59.453913 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:59.519448 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-45f496c2-33af-46c6-9115-3e2e87c5557e None None] Provisioning complete for port ccea3eb1-d1c4-4326-b70b-95e79feb632e triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:27:59.520672 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-45f496c2-33af-46c6-9115-3e2e87c5557e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:27:59.560457 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-45f496c2-33af-46c6-9115-3e2e87c5557e None None] Port ccea3eb1-d1c4-4326-b70b-95e79feb632e cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:27:59.924893 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-975057b4-eede-4005-8fb1-b5d2bc47ae77 req-ce2649d4-0a81-40f2-8f79-780a8c231442 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:27:59.933809 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-975057b4-eede-4005-8fb1-b5d2bc47ae77 req-ce2649d4-0a81-40f2-8f79-780a8c231442 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 932 time: 0.3440084 Nov 18 18:28:00.069393 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-975057b4-eede-4005-8fb1-b5d2bc47ae77 req-b9daed03-56ef-49fd-a91a-ec24d43c4a99 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1345155 Nov 18 18:28:00.084483 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad7e837-59fb-4af1-9536-d24aae35a6cd req-dae8d39a-3a6f-48d4-a3ce-994a036a69df tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:00.086011 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9ad7e837-59fb-4af1-9536-d24aae35a6cd req-dae8d39a-3a6f-48d4-a3ce-994a036a69df tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.1340494 Nov 18 18:28:00.170153 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9ad7e837-59fb-4af1-9536-d24aae35a6cd req-5a18fe38-6c26-4670-b490-8f4b0847f004 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0736670 Nov 18 18:28:00.213819 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ccea3eb1-d1c4-4326-b70b-95e79feb632e {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:28:00.222803 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:00.237598 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Transition to ACTIVE for port object ccea3eb1-d1c4-4326-b70b-95e79feb632e will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:28:00.245296 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:00.374134 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Pushing event updated for resources: {'Port': ['ID=ccea3eb1-d1c4-4326-b70b-95e79feb632e,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:00.392878 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Attempting to bind port ccea3eb1-d1c4-4326-b70b-95e79feb632e on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:28:00.393218 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Attempting to bind port ccea3eb1-d1c4-4326-b70b-95e79feb632e by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:28:00.393549 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Attempting to bind port ccea3eb1-d1c4-4326-b70b-95e79feb632e on network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:28:00.398532 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Port ccea3eb1-d1c4-4326-b70b-95e79feb632e on network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:28:00.398855 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Attempting to bind port ccea3eb1-d1c4-4326-b70b-95e79feb632e on network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:28:00.405764 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 27, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:28:00.405764 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Checking segment: {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:28:00.405764 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Bound using segment: {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:28:00.405764 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Bound port: ccea3eb1-d1c4-4326-b70b-95e79feb632e, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:28:00.405764 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:00.496495 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] For port ccea3eb1-d1c4-4326-b70b-95e79feb632e, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:28:00.500042 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] For port ccea3eb1-d1c4-4326-b70b-95e79feb632e, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ccea3eb1-d1c4-4326-b70b-95e79feb632e,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:28:00.508684 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:00.545316 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:00.547443 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:00.547443 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] 10.222.0.31 "PUT /v2.0/ports/ccea3eb1-d1c4-4326-b70b-95e79feb632e HTTP/1.1" status: 200 len: 1094 time: 1.1736770 Nov 18 18:28:00.549376 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '024f682c-8986-4663-a691-45b3b44d7add', 'tag': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:28:00.551556 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c693be51-ce83-4451-8de6-bb776ed70222" -d '{"events": [{"name": "network-changed", "server_uuid": "024f682c-8986-4663-a691-45b3b44d7add", "tag": "ccea3eb1-d1c4-4326-b70b-95e79feb632e"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:28:00.600304 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-055f3ee8-a6b9-4ec5-a266-0294fd63af4e service neutron] Pushing event updated for resources: {'Port': ['ID=ccea3eb1-d1c4-4326-b70b-95e79feb632e,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:00.688632 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-d9d026cf-9d17-4927-9462-654722b4ff52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:00.703887 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-d9d026cf-9d17-4927-9462-654722b4ff52 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 1097 time: 0.0813477 Nov 18 18:28:00.763546 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-aa15f8f5-7f14-4f22-b39b-29e0d62cf1b6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ccea3eb1-d1c4-4326-b70b-95e79feb632e HTTP/1.1" status: 200 len: 217 time: 0.0462518 Nov 18 18:28:00.825402 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:28:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2db51e8f-10e5-4aec-9e63-a7a8a2e76bc9 x-openstack-request-id: req-2db51e8f-10e5-4aec-9e63-a7a8a2e76bc9 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:28:00.825402 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "024f682c-8986-4663-a691-45b3b44d7add", "tag": "ccea3eb1-d1c4-4326-b70b-95e79feb632e", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:28:00.825593 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-2db51e8f-10e5-4aec-9e63-a7a8a2e76bc9 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:28:00.826033 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '024f682c-8986-4663-a691-45b3b44d7add', 'tag': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e', 'status': 'completed', 'code': 200} Nov 18 18:28:00.840880 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-23a340db-c05d-4ad9-8df4-fb3dda36a972 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:00.842337 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-23a340db-c05d-4ad9-8df4-fb3dda36a972 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0628078 Nov 18 18:28:00.896929 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-c1428228-2eaa-4822-aa74-66d4ca382a70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:00.898462 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-c1428228-2eaa-4822-aa74-66d4ca382a70 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0448611 Nov 18 18:28:01.020343 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-ec5655af-b91c-4480-b99d-4b8afa6305ce service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1115923 Nov 18 18:28:01.126951 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-50dee379-3702-4d56-9d61-845ce3b514d5 req-c0428ad6-285c-4e88-aa0e-808597e01a89 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0973716 Nov 18 18:28:01.243326 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c693be51-ce83-4451-8de6-bb776ed70222 req-af7d7a54-4018-4b00-9041-e9bf1b5c7d14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:01.245561 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c693be51-ce83-4451-8de6-bb776ed70222 req-af7d7a54-4018-4b00-9041-e9bf1b5c7d14 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 1097 time: 0.0532618 Nov 18 18:28:01.258467 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fb6ce1f-cea6-49db-b881-4cdbd760ca5c req-4ec56d5f-9d95-482f-82d7-e79823d34f7c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:01.260581 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3fb6ce1f-cea6-49db-b881-4cdbd760ca5c req-4ec56d5f-9d95-482f-82d7-e79823d34f7c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 944 time: 0.1025612 Nov 18 18:28:01.406107 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3fb6ce1f-cea6-49db-b881-4cdbd760ca5c req-ec7ac143-86b1-475b-aaba-fc999e17338c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1275568 Nov 18 18:28:01.423549 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b9f721f-a93b-41eb-ae87-7190b40498f6 req-fc0aeb24-ef40-4817-80ad-4db3d11824c4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:01.425110 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6b9f721f-a93b-41eb-ae87-7190b40498f6 req-fc0aeb24-ef40-4817-80ad-4db3d11824c4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.1625357 Nov 18 18:28:01.430333 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c693be51-ce83-4451-8de6-bb776ed70222 req-cf686ad0-a2dd-4841-a965-8d5c9f80558f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:01.432407 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c693be51-ce83-4451-8de6-bb776ed70222 req-cf686ad0-a2dd-4841-a965-8d5c9f80558f service neutron] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 913 time: 0.1703401 Nov 18 18:28:01.496695 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c693be51-ce83-4451-8de6-bb776ed70222 req-59012bad-4fa8-44ee-8ef4-c9aa7c2c9894 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ccea3eb1-d1c4-4326-b70b-95e79feb632e HTTP/1.1" status: 200 len: 217 time: 0.0489535 Nov 18 18:28:01.522241 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6b9f721f-a93b-41eb-ae87-7190b40498f6 req-c3b2c98d-2c4e-4757-bfac-3f39cf27a5e4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0888443 Nov 18 18:28:01.572654 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c693be51-ce83-4451-8de6-bb776ed70222 req-daafb54e-5a83-4c65-888d-4e85777b8d82 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:01.574157 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c693be51-ce83-4451-8de6-bb776ed70222 req-daafb54e-5a83-4c65-888d-4e85777b8d82 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0674508 Nov 18 18:28:01.628264 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c693be51-ce83-4451-8de6-bb776ed70222 req-a809b564-2f57-4d02-95f4-cb980809747d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:01.629844 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c693be51-ce83-4451-8de6-bb776ed70222 req-a809b564-2f57-4d02-95f4-cb980809747d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0456562 Nov 18 18:28:01.731773 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c693be51-ce83-4451-8de6-bb776ed70222 req-2f4d7f6b-2737-4eaa-8d19-c03e7d5cd80e service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0932629 Nov 18 18:28:01.837672 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c693be51-ce83-4451-8de6-bb776ed70222 req-09441235-48cc-4230-905f-4ef702516a12 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0974002 Nov 18 18:28:02.531901 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a520650-027f-401c-86fd-60fd0b62115e req-27707b1a-8816-4200-a3f5-81b07c7c44a0 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:02.533678 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1a520650-027f-401c-86fd-60fd0b62115e req-27707b1a-8816-4200-a3f5-81b07c7c44a0 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 944 time: 0.0531781 Nov 18 18:28:02.596756 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1a520650-027f-401c-86fd-60fd0b62115e req-7ea9b8ec-0010-46bf-916d-a31f5f7deb1d tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0568829 Nov 18 18:28:02.655301 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee1ceb61-2662-4863-a8a5-cc655af898c4 req-3a9a75f4-62e2-4e60-b0a9-ea3c0fdff071 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:02.656850 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ee1ceb61-2662-4863-a8a5-cc655af898c4 req-3a9a75f4-62e2-4e60-b0a9-ea3c0fdff071 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0501420 Nov 18 18:28:02.704511 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ee1ceb61-2662-4863-a8a5-cc655af898c4 req-ca162764-5490-4c1e-8f19-749babf306ae tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418646 Nov 18 18:28:03.205820 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06de6ce6-24ad-47ed-81f0-81b07cae021c req-6c859470-d516-40b7-9219-5adc60e9e86c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:03.207201 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-06de6ce6-24ad-47ed-81f0-81b07cae021c req-6c859470-d516-40b7-9219-5adc60e9e86c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 1098 time: 0.0398152 Nov 18 18:28:03.297959 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06de6ce6-24ad-47ed-81f0-81b07cae021c req-b6c3b165-3d81-411d-8bb0-8ecef9478b84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:03.299417 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-06de6ce6-24ad-47ed-81f0-81b07cae021c req-b6c3b165-3d81-411d-8bb0-8ecef9478b84 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 919 time: 0.0848701 Nov 18 18:28:03.366118 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-06de6ce6-24ad-47ed-81f0-81b07cae021c req-ef9c128a-3706-42db-a6ea-4d27a080f989 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=02e0aac7-3022-49e1-8484-d2e56545e298 HTTP/1.1" status: 200 len: 1000 time: 0.0580683 Nov 18 18:28:03.417953 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06de6ce6-24ad-47ed-81f0-81b07cae021c req-b2b315e7-f333-4112-860d-e70f4afd9055 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:03.419364 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-06de6ce6-24ad-47ed-81f0-81b07cae021c req-b2b315e7-f333-4112-860d-e70f4afd9055 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 200 len: 856 time: 0.0461650 Nov 18 18:28:03.464116 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06de6ce6-24ad-47ed-81f0-81b07cae021c req-8632e674-e854-4682-a7d9-389e6de23fd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:03.465509 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-06de6ce6-24ad-47ed-81f0-81b07cae021c req-8632e674-e854-4682-a7d9-389e6de23fd1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d845755f-6a59-4935-8123-1a70c6e45968&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0388975 Nov 18 18:28:03.553516 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-06de6ce6-24ad-47ed-81f0-81b07cae021c req-b2feb62e-94f5-43d7-a5b6-1d19be918934 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800159 Nov 18 18:28:03.647194 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-06de6ce6-24ad-47ed-81f0-81b07cae021c req-ab234de9-cd99-4d1a-9284-8a071e461e09 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859504 Nov 18 18:28:03.710754 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-081576bd-68dc-4e13-95a8-0f4353f8d8b8 req-c65d7dbb-c329-4116-be64-2ef16e8f7520 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:03.712221 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-081576bd-68dc-4e13-95a8-0f4353f8d8b8 req-c65d7dbb-c329-4116-be64-2ef16e8f7520 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 944 time: 0.0478632 Nov 18 18:28:03.765840 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-081576bd-68dc-4e13-95a8-0f4353f8d8b8 req-29760428-55a3-4bff-a664-ab83c4b7e6d5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477524 Nov 18 18:28:03.827826 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef5e6cb-cbef-4a11-82ce-7ea7b405b7ad req-7be45961-d5ad-4d2a-9cce-065341b21e5c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:03.829318 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0ef5e6cb-cbef-4a11-82ce-7ea7b405b7ad req-7be45961-d5ad-4d2a-9cce-065341b21e5c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0515087 Nov 18 18:28:03.875381 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0ef5e6cb-cbef-4a11-82ce-7ea7b405b7ad req-6198b20d-8c86-4ebb-9ab5-91a930e64c2b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403860 Nov 18 18:28:03.991821 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f25e990f-cffa-4ace-ba56-612a41a5f84f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:04.877174 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a203e2d-bf28-4424-8c9e-77e9947a2b4f req-95389377-d9e0-4af0-ae57-d5ec18386965 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:04.878630 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0a203e2d-bf28-4424-8c9e-77e9947a2b4f req-95389377-d9e0-4af0-ae57-d5ec18386965 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 944 time: 0.0470731 Nov 18 18:28:04.926303 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0a203e2d-bf28-4424-8c9e-77e9947a2b4f req-d32f8161-0bda-4829-9266-2e71bcbc86a8 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418768 Nov 18 18:28:04.997401 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad711077-dc52-463e-9165-75c654e3e35a req-503ac043-8057-42f2-afd1-d94c1e95694f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:04.998856 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ad711077-dc52-463e-9165-75c654e3e35a req-503ac043-8057-42f2-afd1-d94c1e95694f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0505009 Nov 18 18:28:05.044347 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ad711077-dc52-463e-9165-75c654e3e35a req-69819f7f-ac32-489a-96ef-55518cfa3d1e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395458 Nov 18 18:28:06.045004 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bb65b73-8dc5-4e24-ae88-58e9cbe73d9f req-8369d753-d5db-4dc1-8920-c78f80ca240d tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:06.046421 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2bb65b73-8dc5-4e24-ae88-58e9cbe73d9f req-8369d753-d5db-4dc1-8920-c78f80ca240d tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 944 time: 0.0544834 Nov 18 18:28:06.094853 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2bb65b73-8dc5-4e24-ae88-58e9cbe73d9f req-062bfa29-e972-41a8-bb04-561cba4f7264 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425904 Nov 18 18:28:06.163447 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe8fbef-5e94-4532-bab3-233e4ac7b382 req-c3193108-cc7e-4174-b413-374249dd4b2c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:06.164957 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ebe8fbef-5e94-4532-bab3-233e4ac7b382 req-c3193108-cc7e-4174-b413-374249dd4b2c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 945 time: 0.0476093 Nov 18 18:28:06.217042 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ebe8fbef-5e94-4532-bab3-233e4ac7b382 req-a5914fa0-ac3b-4e9e-a8e3-224253189063 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458031 Nov 18 18:28:06.437797 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9648f120-7e95-4ba2-83ef-919cb4b31c23 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:06.581663 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 02e0aac7-3022-49e1-8484-d2e56545e298 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:28:06.662584 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:06.685110 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:28:06.687334 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eb205e2f-7614-4da1-b9d4-14ae76bd2316" -d '{"events": [{"server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "name": "network-vif-unplugged", "status": "completed", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:28:06.701321 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=02e0aac7-3022-49e1-8484-d2e56545e298,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:06.706715 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:06.732283 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 18 Nov 2021 18:28:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-90751dc9-f396-4980-97c0-fc987ebbcf97 x-openstack-request-id: req-90751dc9-f396-4980-97c0-fc987ebbcf97 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:28:06.732580 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "name": "network-vif-unplugged", "status": "failed", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298", "code": 422}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:28:06.732839 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-90751dc9-f396-4980-97c0-fc987ebbcf97 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:28:06.733232 dv-cinder-787764-6-iscsi neutron-server[102690]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298', 'code': 422} returned with failed status Nov 18 18:28:06.759298 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=02e0aac7-3022-49e1-8484-d2e56545e298,revision_number=8']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:07.122542 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd44e430-ae11-486a-b312-f0f330ad024b req-5033cf20-6b41-4e14-b4be-b25edd0abc26 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:07.123952 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dd44e430-ae11-486a-b312-f0f330ad024b req-5033cf20-6b41-4e14-b4be-b25edd0abc26 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0696385 Nov 18 18:28:07.150857 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-ca7f18a1-be6d-4383-9838-151be9218651 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0610523 Nov 18 18:28:07.200258 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dd44e430-ae11-486a-b312-f0f330ad024b req-4d44f826-0ddd-43b0-bfcd-b6d0d01c1efa tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0690315 Nov 18 18:28:07.223069 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a73daae-4c39-443e-80ba-08bc7e1252c8 req-ada62504-cd99-4ed2-adbe-8c6fa4b6de64 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:07.224608 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9a73daae-4c39-443e-80ba-08bc7e1252c8 req-ada62504-cd99-4ed2-adbe-8c6fa4b6de64 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 944 time: 0.0605602 Nov 18 18:28:07.278069 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9a73daae-4c39-443e-80ba-08bc7e1252c8 req-eaed4269-2d4d-4cb5-bbad-6fa0455b38bf tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470669 Nov 18 18:28:07.718999 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:07.977874 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-e29bb716-98a2-4317-95db-fc9297022aeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:07.979884 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-e29bb716-98a2-4317-95db-fc9297022aeb service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099&tenant_id=6a79674a70ee4ad7acedc7d4896b413e HTTP/1.1" status: 200 len: 1096 time: 0.0402825 Nov 18 18:28:08.039618 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-82dd04b2-f563-4dce-ad20-fcdd5e4380b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:08.041809 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-82dd04b2-f563-4dce-ad20-fcdd5e4380b6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 1096 time: 0.0382435 Nov 18 18:28:08.138117 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-5601888f-a317-4080-b78a-ff32ff3a40b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:08.139552 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-5601888f-a317-4080-b78a-ff32ff3a40b4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 919 time: 0.0901372 Nov 18 18:28:08.204802 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-e83fff9a-d710-46d5-bacb-92c67e64a5dd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=02e0aac7-3022-49e1-8484-d2e56545e298 HTTP/1.1" status: 200 len: 998 time: 0.0549667 Nov 18 18:28:08.254610 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-29f935fb-827a-475a-9d2f-0740e11db306 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:08.256184 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-29f935fb-827a-475a-9d2f-0740e11db306 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 200 len: 856 time: 0.0434716 Nov 18 18:28:08.333722 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-05f7fa25-d8c8-4b4b-bce4-a8a3573e3b0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:08.335225 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-05f7fa25-d8c8-4b4b-bce4-a8a3573e3b0b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d845755f-6a59-4935-8123-1a70c6e45968&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0702186 Nov 18 18:28:08.343431 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658499e4-61b2-4e86-a509-32d20f31b28a req-b7ae4b18-6581-4eda-9829-71d8c64c2b50 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:08.344864 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-658499e4-61b2-4e86-a509-32d20f31b28a req-b7ae4b18-6581-4eda-9829-71d8c64c2b50 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0715654 Nov 18 18:28:08.476515 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-658499e4-61b2-4e86-a509-32d20f31b28a req-e7e9da25-b9d0-4d2a-a45b-8e160286acca tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1209755 Nov 18 18:28:08.490515 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bca73052-c11c-4372-aa4c-45a74682ced6 req-a8124f48-42b2-44c5-a4f5-7a12c7c92788 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:08.492068 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bca73052-c11c-4372-aa4c-45a74682ced6 req-a8124f48-42b2-44c5-a4f5-7a12c7c92788 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 944 time: 0.1355722 Nov 18 18:28:08.518990 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-32165d95-6dd9-4dff-beef-b1475cf85cf0 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1709278 Nov 18 18:28:08.569775 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bca73052-c11c-4372-aa4c-45a74682ced6 req-2b6f31f3-ac44-45b3-bbe4-b4db76fd49ae tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0678318 Nov 18 18:28:08.584264 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device ccea3eb1-d1c4-4326-b70b-95e79feb632e details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:28:08.635888 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3ed2b994-30ab-46db-9a66-ca569e01732a req-426f8b77-e9ac-492e-b004-ff06357099c5 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1042478 Nov 18 18:28:08.687504 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port ccea3eb1-d1c4-4326-b70b-95e79feb632e, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ccea3eb1-d1c4-4326-b70b-95e79feb632e,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:08.698822 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'port_id': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e', 'mac_address': 'fa:16:3e:4a:ee:19', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1326, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:28:08.738593 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:08.751162 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ccea3eb1-d1c4-4326-b70b-95e79feb632e {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:28:08.769830 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port ccea3eb1-d1c4-4326-b70b-95e79feb632e, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ccea3eb1-d1c4-4326-b70b-95e79feb632e,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:08.773774 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:08.822726 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=ccea3eb1-d1c4-4326-b70b-95e79feb632e,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:09.068126 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['ccea3eb1-d1c4-4326-b70b-95e79feb632e'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:28:09.105859 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:09.474537 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:28:09.605773 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e01760c-e880-44e1-b517-9b3ab703048b req-73fb2132-ff32-481c-93f2-aa064cf15e9c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:09.607323 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6e01760c-e880-44e1-b517-9b3ab703048b req-73fb2132-ff32-481c-93f2-aa064cf15e9c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0565088 Nov 18 18:28:09.657878 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6e01760c-e880-44e1-b517-9b3ab703048b req-7f7117b1-34c9-4c8d-81dd-1ba3fc2146a7 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445485 Nov 18 18:28:09.788667 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f23d61a8-76cc-414b-92da-758882fa9151 req-f9b8ac26-9551-4b34-8ac1-587bdb697375 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:09.790196 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f23d61a8-76cc-414b-92da-758882fa9151 req-f9b8ac26-9551-4b34-8ac1-587bdb697375 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 945 time: 0.0743518 Nov 18 18:28:09.841454 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f23d61a8-76cc-414b-92da-758882fa9151 req-2da2bc2b-e8fb-4372-8e21-839fb917ccb8 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448246 Nov 18 18:28:10.186370 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:10.594777 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device ccea3eb1-d1c4-4326-b70b-95e79feb632e up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:28:10.643988 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port ccea3eb1-d1c4-4326-b70b-95e79feb632e completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:28:10.648048 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port ccea3eb1-d1c4-4326-b70b-95e79feb632e triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:28:10.648419 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:10.730186 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:10.754962 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '024f682c-8986-4663-a691-45b3b44d7add', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:28:10.765680 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b3d8a8a-0dc8-4008-bde5-2ebf52cac23b" -d '{"events": [{"server_uuid": "024f682c-8986-4663-a691-45b3b44d7add", "name": "network-vif-plugged", "status": "completed", "tag": "ccea3eb1-d1c4-4326-b70b-95e79feb632e"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:28:10.786738 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port ccea3eb1-d1c4-4326-b70b-95e79feb632e, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ccea3eb1-d1c4-4326-b70b-95e79feb632e,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:10.791856 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:10.802512 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d1d84a3-9ea6-4a87-9cce-96856fe41f7e req-3417783b-20c2-484a-8c40-71d63d9ee0bd tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:10.804037 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2d1d84a3-9ea6-4a87-9cce-96856fe41f7e req-3417783b-20c2-484a-8c40-71d63d9ee0bd tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0699813 Nov 18 18:28:10.842050 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=ccea3eb1-d1c4-4326-b70b-95e79feb632e,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:10.868320 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2d1d84a3-9ea6-4a87-9cce-96856fe41f7e req-8f0ea442-5b93-46ce-84d5-ea0a305483ad tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0564713 Nov 18 18:28:10.914507 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:28:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2b2cfd89-a31f-4793-bcfc-9fd65558dcb4 x-openstack-request-id: req-2b2cfd89-a31f-4793-bcfc-9fd65558dcb4 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:28:10.914911 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "024f682c-8986-4663-a691-45b3b44d7add", "name": "network-vif-plugged", "status": "completed", "tag": "ccea3eb1-d1c4-4326-b70b-95e79feb632e", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:28:10.915274 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-2b2cfd89-a31f-4793-bcfc-9fd65558dcb4 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:28:10.916602 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '024f682c-8986-4663-a691-45b3b44d7add', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e', 'code': 200} Nov 18 18:28:11.012258 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f750d5e9-41b6-4e31-8ae1-366b8fb8b5d7 req-a2581b74-f664-4a9a-8090-61beb5fe2847 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:11.013738 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f750d5e9-41b6-4e31-8ae1-366b8fb8b5d7 req-a2581b74-f664-4a9a-8090-61beb5fe2847 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0547411 Nov 18 18:28:11.064511 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f750d5e9-41b6-4e31-8ae1-366b8fb8b5d7 req-12cc0a26-78cf-4976-a7c7-5f4e4c7f9503 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448732 Nov 18 18:28:11.991509 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61a38ec9-8537-4184-9a12-8431e2aa31a1 req-aef88d5a-ba94-4802-b320-f79fd8d0a239 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:11.998957 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-61a38ec9-8537-4184-9a12-8431e2aa31a1 req-aef88d5a-ba94-4802-b320-f79fd8d0a239 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0568788 Nov 18 18:28:12.040979 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-61a38ec9-8537-4184-9a12-8431e2aa31a1 req-230a2b65-b87f-4ded-9b16-5f071a160b39 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410368 Nov 18 18:28:12.183654 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d35e3cd7-26f2-4a0c-94ee-723c2c2ff235 req-81c3a25a-5569-43a5-9348-1c56f8d17893 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:12.185377 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d35e3cd7-26f2-4a0c-94ee-723c2c2ff235 req-81c3a25a-5569-43a5-9348-1c56f8d17893 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0519958 Nov 18 18:28:12.237838 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d35e3cd7-26f2-4a0c-94ee-723c2c2ff235 req-75ca149e-af20-4c86-8bfb-e8a1fd7ac99b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462673 Nov 18 18:28:13.163125 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03b564e1-5a03-411b-afa8-f19ee0b57f2b req-bc0234ad-cd38-4202-9189-f4882c96d7e8 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:13.164666 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-03b564e1-5a03-411b-afa8-f19ee0b57f2b req-bc0234ad-cd38-4202-9189-f4882c96d7e8 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0526717 Nov 18 18:28:13.213820 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-03b564e1-5a03-411b-afa8-f19ee0b57f2b req-a7ef7422-6f10-4604-82b9-b3e35bc5fec4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419815 Nov 18 18:28:13.361446 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a507b0-8c72-4ebc-9ae8-a18b9d536d7c req-aed2cf39-0b21-4143-80c8-fe65e7f0bbc8 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:13.362966 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-03a507b0-8c72-4ebc-9ae8-a18b9d536d7c req-aed2cf39-0b21-4143-80c8-fe65e7f0bbc8 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0577877 Nov 18 18:28:13.414933 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-03a507b0-8c72-4ebc-9ae8-a18b9d536d7c req-be6468c1-7c8c-4d11-bb53-91e76541a3d0 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457425 Nov 18 18:28:14.336872 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf890ce-4c6f-44b9-a4df-cd390225bb91 req-d2bfeffc-4ae6-4997-821f-b731f2062f68 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:14.338456 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dcf890ce-4c6f-44b9-a4df-cd390225bb91 req-d2bfeffc-4ae6-4997-821f-b731f2062f68 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0515738 Nov 18 18:28:14.391611 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-dcf890ce-4c6f-44b9-a4df-cd390225bb91 req-f023bf3d-218b-4ef9-b7fe-809811888cc2 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468798 Nov 18 18:28:14.532293 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5366f727-4988-4485-9ae0-bc6f7319b920 req-940d9534-4dbd-437b-95b3-15d6e0618a60 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:14.533698 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5366f727-4988-4485-9ae0-bc6f7319b920 req-940d9534-4dbd-437b-95b3-15d6e0618a60 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0492744 Nov 18 18:28:14.587007 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5366f727-4988-4485-9ae0-bc6f7319b920 req-f40e418b-9b52-4ceb-9ec4-848809131515 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459509 Nov 18 18:28:15.515109 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4802bbe-05b8-495e-90d2-ca4aa8b82d79 req-c0575871-3ac3-4fb7-be9d-512d6968a8f3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:15.516646 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c4802bbe-05b8-495e-90d2-ca4aa8b82d79 req-c0575871-3ac3-4fb7-be9d-512d6968a8f3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0510569 Nov 18 18:28:15.567538 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c4802bbe-05b8-495e-90d2-ca4aa8b82d79 req-017fc046-98b2-44f5-9e0d-ff1f95fb1e2a tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447154 Nov 18 18:28:15.707219 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccce55c1-26b3-48b1-988a-8ee3494c201f req-6e4308e7-b038-4463-94be-84576b3c9d21 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:15.708799 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ccce55c1-26b3-48b1-988a-8ee3494c201f req-6e4308e7-b038-4463-94be-84576b3c9d21 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0533755 Nov 18 18:28:15.760263 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ccce55c1-26b3-48b1-988a-8ee3494c201f req-a2f7979e-e87d-4fcd-9fa4-4e8278a924c8 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450957 Nov 18 18:28:16.690791 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2dfa6c0-9107-40a3-a671-7d26c4f20df9 req-12b3016d-0331-45f5-8d62-ac72aa89c5fb tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:16.692349 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c2dfa6c0-9107-40a3-a671-7d26c4f20df9 req-12b3016d-0331-45f5-8d62-ac72aa89c5fb tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0517211 Nov 18 18:28:16.742399 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c2dfa6c0-9107-40a3-a671-7d26c4f20df9 req-f0acc7a6-2c63-474e-ae94-887829679f24 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437791 Nov 18 18:28:16.879688 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e309959-c489-4370-9e5e-e350772ac462 req-c6b49b74-f77b-4cf4-8c5f-00a934a5fc14 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:16.881145 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9e309959-c489-4370-9e5e-e350772ac462 req-c6b49b74-f77b-4cf4-8c5f-00a934a5fc14 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0531123 Nov 18 18:28:16.931729 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9e309959-c489-4370-9e5e-e350772ac462 req-f7ac596d-a159-4e37-abe9-66ee044c86ba tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443964 Nov 18 18:28:17.863621 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84be9bec-8344-4418-bde5-05659b04cd4e req-2f6ea4f0-0f90-4e19-a747-073822f868f4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:17.865338 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-84be9bec-8344-4418-bde5-05659b04cd4e req-2f6ea4f0-0f90-4e19-a747-073822f868f4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0515208 Nov 18 18:28:17.911559 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-84be9bec-8344-4418-bde5-05659b04cd4e req-705325dc-5a07-4044-aaa1-b15a6278754b tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404608 Nov 18 18:28:18.048046 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7924cbe-e95a-43e2-bae0-3f8521082d07 req-f47ec964-834b-4668-99e3-4fa79277bc9b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:18.049826 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e7924cbe-e95a-43e2-bae0-3f8521082d07 req-f47ec964-834b-4668-99e3-4fa79277bc9b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0530868 Nov 18 18:28:18.102476 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e7924cbe-e95a-43e2-bae0-3f8521082d07 req-8f59c1f9-60b7-46bb-b517-b8b7d2ac6fb5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467014 Nov 18 18:28:19.034479 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c945fe-5dbf-48f9-b29b-155d20211c58 req-e0eca18e-3539-4ae5-8bba-fbf0cdda37ed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:19.036032 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e0c945fe-5dbf-48f9-b29b-155d20211c58 req-e0eca18e-3539-4ae5-8bba-fbf0cdda37ed tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0527081 Nov 18 18:28:19.089785 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e0c945fe-5dbf-48f9-b29b-155d20211c58 req-d937e7e5-7bcb-44de-9733-f77f55f95d8f tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478685 Nov 18 18:28:19.227273 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25704d20-3707-4e70-a52a-b9de9b6155d3 req-9401d137-941c-4484-9240-ef7dcbedc00d tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:19.228800 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-25704d20-3707-4e70-a52a-b9de9b6155d3 req-9401d137-941c-4484-9240-ef7dcbedc00d tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0556006 Nov 18 18:28:19.285402 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-25704d20-3707-4e70-a52a-b9de9b6155d3 req-32a97808-2037-424f-9eaa-1872bb140c26 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0502343 Nov 18 18:28:20.182892 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4138c4cc-7301-4de5-b360-b6f86ec6513d req-b70f5cee-8c2d-4f18-becd-fe3b2282f00e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:20.184077 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4138c4cc-7301-4de5-b360-b6f86ec6513d req-b70f5cee-8c2d-4f18-becd-fe3b2282f00e service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 1099 time: 0.0570526 Nov 18 18:28:20.249217 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4138c4cc-7301-4de5-b360-b6f86ec6513d req-1c61bfe1-a795-4b64-bab3-b3147c4170d2 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0513864 Nov 18 18:28:20.257515 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20b193f5-61b7-416c-b39a-68111fd45f1b req-fa545ff0-6e4d-46e0-9372-dd265225fe58 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:20.259060 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-20b193f5-61b7-416c-b39a-68111fd45f1b req-fa545ff0-6e4d-46e0-9372-dd265225fe58 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0896294 Nov 18 18:28:20.308395 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-20b193f5-61b7-416c-b39a-68111fd45f1b req-71db54e0-a026-4185-ad94-8c2f0dfffe95 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418060 Nov 18 18:28:20.403966 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553f0284-3514-41fa-81d4-bf040d04f541 req-c85870ce-73cc-434d-9cda-889b5f453f9a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:20.405441 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-553f0284-3514-41fa-81d4-bf040d04f541 req-c85870ce-73cc-434d-9cda-889b5f453f9a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0472925 Nov 18 18:28:20.456220 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-553f0284-3514-41fa-81d4-bf040d04f541 req-8fe411e9-21ca-4358-874b-6ad06ee0cb8a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448601 Nov 18 18:28:21.158897 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:21.431237 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d63a6c20-2ef0-4af5-b062-ee404412f14f req-644add93-d15c-4563-a07c-5ec612d16849 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:21.432770 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d63a6c20-2ef0-4af5-b062-ee404412f14f req-644add93-d15c-4563-a07c-5ec612d16849 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.0507057 Nov 18 18:28:21.483212 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d63a6c20-2ef0-4af5-b062-ee404412f14f req-d2605ded-1717-402e-9857-30600669f850 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431499 Nov 18 18:28:21.589969 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b4a0d1f-e240-43cc-a265-943ea8d11a44 req-5d23c750-7314-4dbd-a430-ce147115ef1f tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:21.591690 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5b4a0d1f-e240-43cc-a265-943ea8d11a44 req-5d23c750-7314-4dbd-a430-ce147115ef1f tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0505440 Nov 18 18:28:21.644003 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-5b4a0d1f-e240-43cc-a265-943ea8d11a44 req-8a31fc5a-b37a-4420-96a9-4cc19a29e159 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445588 Nov 18 18:28:21.760777 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d565b2-f7be-4ae1-9f5c-185041eb3437 req-deda4226-0860-4ef4-b0c5-ac2b32815695 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:21.762297 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-90d565b2-f7be-4ae1-9f5c-185041eb3437 req-deda4226-0860-4ef4-b0c5-ac2b32815695 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0515826 Nov 18 18:28:21.810630 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-90d565b2-f7be-4ae1-9f5c-185041eb3437 req-c34e0894-3736-45bd-855d-d1a548cc0ecd tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423255 Nov 18 18:28:21.831873 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44572) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:21.960262 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9e36ea6-1042-42c2-8c20-a1c168190c36 tempest-TestVolumeBootPattern-190622742 tempest-TestVolumeBootPattern-190622742-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:21.961667 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-e9e36ea6-1042-42c2-8c20-a1c168190c36 tempest-TestVolumeBootPattern-190622742 tempest-TestVolumeBootPattern-190622742-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 1094 time: 0.1288087 Nov 18 18:28:21.965241 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44576) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:21.969763 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'floatingip': {'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'port_id': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address': '172.20.0.12'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:28:21.992849 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:22.087918 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:22.189255 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Allocated IP 172.27.1.222 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/d903e57f-385c-4cf9-af46-da8862086747) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:28:22.290482 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:22.320937 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:22.355741 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:28:22.358444 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:28:22.362539 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:28:22.387482 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'Port': ['ID=d903e57f-385c-4cf9-af46-da8862086747,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:22.656649 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 02e0aac7-3022-49e1-8484-d2e56545e298 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:28:22.753125 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=02e0aac7-3022-49e1-8484-d2e56545e298,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:22.768099 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '02e0aac7-3022-49e1-8484-d2e56545e298', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'port_id': '02e0aac7-3022-49e1-8484-d2e56545e298', 'mac_address': 'fa:16:3e:bb:bc:02', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1342, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:28:22.803912 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:22.816778 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5fa32cd-1a7c-4282-8df2-a410498ce546 req-28a251d5-2ad9-43e3-a6a1-919b8485f366 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:22.817324 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 02e0aac7-3022-49e1-8484-d2e56545e298 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:28:22.818258 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a5fa32cd-1a7c-4282-8df2-a410498ce546 req-28a251d5-2ad9-43e3-a6a1-919b8485f366 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 1096 time: 0.1229229 Nov 18 18:28:22.828710 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d1a605f-cb77-4001-864e-a743cf01e596 req-12b504d0-3c1b-4f9a-9ae1-b235d327d695 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:22.830339 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2d1a605f-cb77-4001-864e-a743cf01e596 req-12b504d0-3c1b-4f9a-9ae1-b235d327d695 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 943 time: 0.1362302 Nov 18 18:28:22.839948 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=02e0aac7-3022-49e1-8484-d2e56545e298,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:22.844101 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:22.891082 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=02e0aac7-3022-49e1-8484-d2e56545e298,revision_number=9']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:22.898186 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:22.898465 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:22.898807 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:22.899141 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:22.899471 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:22.899804 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:22.900166 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:22.900491 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:22.900818 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:22.901141 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:22.901460 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:22.901812 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:23.035963 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2d1a605f-cb77-4001-864e-a743cf01e596 req-bd808fc7-9d50-4118-9d42-24400bd08e1e tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1943083 Nov 18 18:28:23.044897 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5fa32cd-1a7c-4282-8df2-a410498ce546 req-c174c452-fdbb-4528-b51d-3c7acc86f012 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:23.046321 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a5fa32cd-1a7c-4282-8df2-a410498ce546 req-c174c452-fdbb-4528-b51d-3c7acc86f012 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 200 len: 919 time: 0.2058711 Nov 18 18:28:23.089854 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['02e0aac7-3022-49e1-8484-d2e56545e298'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:28:23.167210 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a5fa32cd-1a7c-4282-8df2-a410498ce546 req-5a810338-ab89-4d35-adcb-d366a8996863 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=02e0aac7-3022-49e1-8484-d2e56545e298 HTTP/1.1" status: 200 len: 999 time: 0.1125267 Nov 18 18:28:23.192086 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:23.259632 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5fa32cd-1a7c-4282-8df2-a410498ce546 req-ca45c7d1-6003-4bc1-a85e-24d3a144f9ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:23.261261 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a5fa32cd-1a7c-4282-8df2-a410498ce546 req-ca45c7d1-6003-4bc1-a85e-24d3a144f9ed service neutron] 10.222.0.31 "GET /v2.0/subnets?id=690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 200 len: 856 time: 0.0814216 Nov 18 18:28:23.314585 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:23.359305 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5fa32cd-1a7c-4282-8df2-a410498ce546 req-2656e056-509c-4c55-b7ed-e35fa05b3833 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:23.361060 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a5fa32cd-1a7c-4282-8df2-a410498ce546 req-2656e056-509c-4c55-b7ed-e35fa05b3833 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d845755f-6a59-4935-8123-1a70c6e45968&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0902760 Nov 18 18:28:23.522790 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a5fa32cd-1a7c-4282-8df2-a410498ce546 req-164bef6b-18fd-4802-985d-157260aab792 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1530523 Nov 18 18:28:23.555787 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:23.563103 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:23.668364 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'Port': ['ID=d903e57f-385c-4cf9-af46-da8862086747,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:23.692916 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:23.696000 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a5fa32cd-1a7c-4282-8df2-a410498ce546 req-2e5f6072-a0d2-4fc8-8bb3-3498b8c54283 service neutron] 10.222.0.31 "GET /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1631894 Nov 18 18:28:23.795270 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Floating IP c515b9f1-ac39-4719-b3db-b5ca3ba6d43f associated. External IP: 172.27.1.222, port: ccea3eb1-d1c4-4326-b70b-95e79feb632e. Nov 18 18:28:24.003516 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Router ae4f264c-d828-44a7-ab29-e11545372d21 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:28:24.112494 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:28:24.122430 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3119c9e1-2972-406e-ae8e-65da272833b9 None None] Sync routers for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:28:24.132489 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3119c9e1-2972-406e-ae8e-65da272833b9 None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:28:24.133106 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-3119c9e1-2972-406e-ae8e-65da272833b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:28:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:24.155176 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:24.187215 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-707c6105-8374-4f0b-9f07-e20d2c554a46 req-8d2a542b-cb7b-4be3-adda-a3651a7094af tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:24.188772 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-707c6105-8374-4f0b-9f07-e20d2c554a46 req-8d2a542b-cb7b-4be3-adda-a3651a7094af tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 944 time: 0.0787189 Nov 18 18:28:24.197705 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-db4840f0-3cf2-4aa1-a21b-ccdd67eaf79b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.2312520 Nov 18 18:28:24.200108 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '024f682c-8986-4663-a691-45b3b44d7add', 'tag': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:28:24.202358 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-962e80f5-bf76-4784-a1a2-f014a3277c03" -d '{"events": [{"name": "network-changed", "server_uuid": "024f682c-8986-4663-a691-45b3b44d7add", "tag": "ccea3eb1-d1c4-4326-b70b-95e79feb632e"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:28:24.239489 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:28:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-29820aa7-6b51-48a6-a61d-612b42776b1d x-openstack-request-id: req-29820aa7-6b51-48a6-a61d-612b42776b1d {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:28:24.239781 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "024f682c-8986-4663-a691-45b3b44d7add", "tag": "ccea3eb1-d1c4-4326-b70b-95e79feb632e", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:28:24.240062 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-29820aa7-6b51-48a6-a61d-612b42776b1d {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:28:24.240591 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '024f682c-8986-4663-a691-45b3b44d7add', 'tag': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e', 'status': 'completed', 'code': 200} Nov 18 18:28:24.242095 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-3119c9e1-2972-406e-ae8e-65da272833b9 None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:28:24.256516 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-707c6105-8374-4f0b-9f07-e20d2c554a46 req-193a229d-d474-48ee-9ec3-b2737e897b6c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0576134 Nov 18 18:28:24.300747 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962e80f5-bf76-4784-a1a2-f014a3277c03 req-d56128ef-e316-492f-88a9-ee8365c973ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:24.302240 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-962e80f5-bf76-4784-a1a2-f014a3277c03 req-d56128ef-e316-492f-88a9-ee8365c973ba service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 1099 time: 0.0396249 Nov 18 18:28:24.395433 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962e80f5-bf76-4784-a1a2-f014a3277c03 req-58154239-47e1-4e65-bf24-d6e091d16d1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:24.396925 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-962e80f5-bf76-4784-a1a2-f014a3277c03 req-58154239-47e1-4e65-bf24-d6e091d16d1f service neutron] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 913 time: 0.0855026 Nov 18 18:28:24.460798 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-962e80f5-bf76-4784-a1a2-f014a3277c03 req-dc4c1fda-c291-47f3-85e1-d00ce1bc5058 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ccea3eb1-d1c4-4326-b70b-95e79feb632e HTTP/1.1" status: 200 len: 1000 time: 0.0558362 Nov 18 18:28:24.464659 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-3119c9e1-2972-406e-ae8e-65da272833b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': 'c515b9f1-ac39-4719-b3db-b5ca3ba6d43f', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.222', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 570, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:4a:ee:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '024f682c-8986-4663-a691-45b3b44d7add', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:28:22Z', 'updated_at': '2021-11-18T18:28:22Z', 'revision_number': 0, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:24.490427 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3119c9e1-2972-406e-ae8e-65da272833b9 None None] Checking router: ae4f264c-d828-44a7-ab29-e11545372d21 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:28:24.499233 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3119c9e1-2972-406e-ae8e-65da272833b9 None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:28:24.499830 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-3119c9e1-2972-406e-ae8e-65da272833b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:28:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:24.510096 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962e80f5-bf76-4784-a1a2-f014a3277c03 req-d940c2ce-8d35-4663-8bf4-9e61a4d8bdd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:24.512175 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-962e80f5-bf76-4784-a1a2-f014a3277c03 req-d940c2ce-8d35-4663-8bf4-9e61a4d8bdd2 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0430651 Nov 18 18:28:24.562839 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962e80f5-bf76-4784-a1a2-f014a3277c03 req-016fcf7d-ae29-45f4-b340-3ea70b698db8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:24.564354 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-962e80f5-bf76-4784-a1a2-f014a3277c03 req-016fcf7d-ae29-45f4-b340-3ea70b698db8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0427594 Nov 18 18:28:24.603730 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-3119c9e1-2972-406e-ae8e-65da272833b9 None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:28:24.653164 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-962e80f5-bf76-4784-a1a2-f014a3277c03 req-7c9a5a22-9979-47c9-a569-96620d19f3e1 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802617 Nov 18 18:28:24.676731 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 02e0aac7-3022-49e1-8484-d2e56545e298 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:28:24.749577 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-962e80f5-bf76-4784-a1a2-f014a3277c03 req-259f6686-ff4e-4dfe-98c2-92924671cc6c service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0885119 Nov 18 18:28:24.799113 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 02e0aac7-3022-49e1-8484-d2e56545e298 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:28:24.799489 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:24.928767 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:24.933153 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-3119c9e1-2972-406e-ae8e-65da272833b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': 'c515b9f1-ac39-4719-b3db-b5ca3ba6d43f', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.222', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 570, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:4a:ee:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '024f682c-8986-4663-a691-45b3b44d7add', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:28:22Z', 'updated_at': '2021-11-18T18:28:22Z', 'revision_number': 0, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:24.964832 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3119c9e1-2972-406e-ae8e-65da272833b9 None None] The sync data for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi is: [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': 'c515b9f1-ac39-4719-b3db-b5ca3ba6d43f', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.222', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 570, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:4a:ee:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '024f682c-8986-4663-a691-45b3b44d7add', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:28:22Z', 'updated_at': '2021-11-18T18:28:22Z', 'revision_number': 0, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:28:24.978652 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:28:24.981519 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f21e5fae-fc35-41a7-bae0-029aba78c0b9" -d '{"events": [{"server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "name": "network-vif-plugged", "status": "completed", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:28:24.994504 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=02e0aac7-3022-49e1-8484-d2e56545e298,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:24.998303 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:25.024343 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:28:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc22b246-d6c3-4319-83c6-ee70a1e124e6 x-openstack-request-id: req-bc22b246-d6c3-4319-83c6-ee70a1e124e6 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:28:25.024643 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "name": "network-vif-plugged", "status": "completed", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:28:25.024897 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-bc22b246-d6c3-4319-83c6-ee70a1e124e6 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:28:25.025289 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298', 'code': 200} Nov 18 18:28:25.054718 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=02e0aac7-3022-49e1-8484-d2e56545e298,revision_number=10']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:25.171562 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d79e146-93a2-44a5-a1cd-89d5f5d2f5cf None None] New status for floating IP c515b9f1-ac39-4719-b3db-b5ca3ba6d43f: ACTIVE {{(pid=102691) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:28:25.218470 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cccf09dc-4e42-4978-a515-8b715be78473 req-96691a6a-9158-4706-8bb9-008f9e23a903 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:25.219889 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-cccf09dc-4e42-4978-a515-8b715be78473 req-96691a6a-9158-4706-8bb9-008f9e23a903 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 1099 time: 0.0394738 Nov 18 18:28:25.265486 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-cccf09dc-4e42-4978-a515-8b715be78473 req-02270dda-cbc1-42f6-9283-cba6d7bc39a4 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0369391 Nov 18 18:28:25.381437 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba2cba6b-5d25-4c79-ad78-7e05013cb8cd req-21cda505-319e-4343-8b48-1d9fe87ef630 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:25.382907 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ba2cba6b-5d25-4c79-ad78-7e05013cb8cd req-21cda505-319e-4343-8b48-1d9fe87ef630 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 946 time: 0.0514579 Nov 18 18:28:25.429319 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ba2cba6b-5d25-4c79-ad78-7e05013cb8cd req-53b162b8-3028-44f8-9ee8-72606ca99e07 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399132 Nov 18 18:28:26.549696 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5ac6e57-a826-416a-ae60-bbe9ac1163c8 req-b9ee676a-d43c-40ac-b178-b419eba10225 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:26.551378 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c5ac6e57-a826-416a-ae60-bbe9ac1163c8 req-b9ee676a-d43c-40ac-b178-b419eba10225 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 946 time: 0.0492153 Nov 18 18:28:26.601341 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c5ac6e57-a826-416a-ae60-bbe9ac1163c8 req-a83809ef-914c-49bc-8940-78efe91694e0 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417347 Nov 18 18:28:27.719007 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59dd2b3c-95cd-46d5-85ad-e669fb64cfa9 req-fe17ccc0-5187-46d5-9605-101924a6a60c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:27.720499 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-59dd2b3c-95cd-46d5-85ad-e669fb64cfa9 req-fe17ccc0-5187-46d5-9605-101924a6a60c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 946 time: 0.0472469 Nov 18 18:28:27.769047 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-59dd2b3c-95cd-46d5-85ad-e669fb64cfa9 req-a4e9bfd0-8f65-4c69-95fc-f201e33a0b9c tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425153 Nov 18 18:28:33.992931 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-2b69505d-f12a-4d6f-9037-3ba1196ac1f4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:36.439194 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-576f1f1f-4fa1-41c4-a7d5-bf88ce9a2e6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:37.402099 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44690) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:37.724338 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:37.876852 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Deleting port 8c822430-30a9-4247-8f8c-5b8757442b3d {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:28:37.877189 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:37.948410 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:37.948737 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:37.960769 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Calling delete_port for 8c822430-30a9-4247-8f8c-5b8757442b3d owned by network:floatingip {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:28:38.125703 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:38.154199 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event deleted for resources: {'Port': ['ID=8c822430-30a9-4247-8f8c-5b8757442b3d,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:38.177710 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:38.178062 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:38.178405 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:38.178744 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:38.179079 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:38.179409 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:38.179735 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:38.180113 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:38.180461 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:38.180786 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:38.181110 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:38.181431 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:38.221003 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for floatingip, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:38.221329 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Floating IP f68ff9ac-17c9-4d9e-b90b-0cf8d3efecc5 disassociated (deleted). External IP: 172.27.1.45, port: 85e36ba2-dd4d-47c9-b794-f9104af3235f. Nov 18 18:28:38.424239 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Router 0f9804e2-48c3-4648-b16c-33eeec3a9305 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:28:38.529770 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:28:38.534964 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:38.538952 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d79f30d-1222-4a0c-bb77-7ecfc7a16cab None None] Sync routers for ids ['0f9804e2-48c3-4648-b16c-33eeec3a9305'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:28:38.549032 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d79f30d-1222-4a0c-bb77-7ecfc7a16cab None None] Routers {'0f9804e2-48c3-4648-b16c-33eeec3a9305'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:28:38.549636 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-8d79f30d-1222-4a0c-bb77-7ecfc7a16cab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:28:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['0f9804e2-48c3-4648-b16c-33eeec3a9305'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:38.562005 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-5539af16-bad8-4130-a16e-70a1166641e5 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "DELETE /v2.0/floatingips/f68ff9ac-17c9-4d9e-b90b-0cf8d3efecc5 HTTP/1.1" status: 204 len: 168 time: 1.1588035 Nov 18 18:28:38.562605 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:28:38.564957 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-65dd7a03-c8df-4324-b545-466a5476d830" -d '{"events": [{"name": "network-changed", "server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:28:38.604681 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:28:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-16672bf4-9dd4-4704-969b-7f36123818cd x-openstack-request-id: req-16672bf4-9dd4-4704-969b-7f36123818cd {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:28:38.605165 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:28:38.605490 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-16672bf4-9dd4-4704-969b-7f36123818cd {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:28:38.606608 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'status': 'completed', 'code': 200} Nov 18 18:28:38.661355 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-8d79f30d-1222-4a0c-bb77-7ecfc7a16cab None None] Set router 0f9804e2-48c3-4648-b16c-33eeec3a9305 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:28:38.681855 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65dd7a03-c8df-4324-b545-466a5476d830 req-8652a0c9-02fb-4a1a-8bea-b73c9280369c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:38.683582 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65dd7a03-c8df-4324-b545-466a5476d830 req-8652a0c9-02fb-4a1a-8bea-b73c9280369c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=029e580af1e3498aa00c86f5ce660a80&device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 1099 time: 0.0483086 Nov 18 18:28:38.823884 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65dd7a03-c8df-4324-b545-466a5476d830 req-59994392-4b69-494c-999f-e576e382dcf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:38.825946 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65dd7a03-c8df-4324-b545-466a5476d830 req-59994392-4b69-494c-999f-e576e382dcf4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a HTTP/1.1" status: 200 len: 909 time: 0.1267557 Nov 18 18:28:38.834293 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c82a486a-b552-41d7-b189-7cb7fac71427 req-d2a8c5df-a679-4a3a-978a-bdb868a487aa tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:38.835672 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c82a486a-b552-41d7-b189-7cb7fac71427 req-d2a8c5df-a679-4a3a-978a-bdb868a487aa tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0677855 Nov 18 18:28:38.875128 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-8d79f30d-1222-4a0c-bb77-7ecfc7a16cab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:16Z', 'revision_number': 4, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '4f9ac680-4b89-4f65-bc06-6239f90f19f3', 'name': '', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'mac_address': 'fa:16:3e:ae:a5:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_interface', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:16Z', 'updated_at': '2021-11-18T18:23:20Z', 'revision_number': 5, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'subnets': [{'id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:38.881188 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65dd7a03-c8df-4324-b545-466a5476d830 req-ff421421-a88c-4255-ac0e-6a6a635842de service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f HTTP/1.1" status: 200 len: 217 time: 0.0445328 Nov 18 18:28:38.901968 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d79f30d-1222-4a0c-bb77-7ecfc7a16cab None None] Checking router: 0f9804e2-48c3-4648-b16c-33eeec3a9305 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:28:38.910742 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d79f30d-1222-4a0c-bb77-7ecfc7a16cab None None] Routers {'0f9804e2-48c3-4648-b16c-33eeec3a9305'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:28:38.911339 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-8d79f30d-1222-4a0c-bb77-7ecfc7a16cab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:28:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['0f9804e2-48c3-4648-b16c-33eeec3a9305'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:38.950200 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c82a486a-b552-41d7-b189-7cb7fac71427 req-a03a2f09-97e3-48df-8d9f-cba37e37a43d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1059391 Nov 18 18:28:38.956104 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65dd7a03-c8df-4324-b545-466a5476d830 req-4ee09d1c-09f1-4fb0-83f2-aaf69b4c88af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:38.957261 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65dd7a03-c8df-4324-b545-466a5476d830 req-4ee09d1c-09f1-4fb0-83f2-aaf69b4c88af service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cac1be0a-3676-49bd-8292-3623cc0fc8b1 HTTP/1.1" status: 200 len: 846 time: 0.0639768 Nov 18 18:28:39.010278 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65dd7a03-c8df-4324-b545-466a5476d830 req-3e0802ab-014c-4ed6-8273-309fef5be218 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:39.011842 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65dd7a03-c8df-4324-b545-466a5476d830 req-3e0802ab-014c-4ed6-8273-309fef5be218 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0411353 Nov 18 18:28:39.114264 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65dd7a03-c8df-4324-b545-466a5476d830 req-98bbc42b-4156-4fa9-be4a-2feb812bc68d service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0898101 Nov 18 18:28:39.142214 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:39.149138 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-8d79f30d-1222-4a0c-bb77-7ecfc7a16cab None None] Set router 0f9804e2-48c3-4648-b16c-33eeec3a9305 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:28:39.205650 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-65dd7a03-c8df-4324-b545-466a5476d830 req-2ade3e78-1b1e-45ea-b9dd-b66b3812cea4 service neutron] 10.222.0.31 "GET /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819426 Nov 18 18:28:39.343864 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-8d79f30d-1222-4a0c-bb77-7ecfc7a16cab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:16Z', 'revision_number': 4, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '4f9ac680-4b89-4f65-bc06-6239f90f19f3', 'name': '', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'mac_address': 'fa:16:3e:ae:a5:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_interface', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:16Z', 'updated_at': '2021-11-18T18:23:20Z', 'revision_number': 5, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'subnets': [{'id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:39.373913 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d79f30d-1222-4a0c-bb77-7ecfc7a16cab None None] The sync data for ids ['0f9804e2-48c3-4648-b16c-33eeec3a9305'] in dv-cinder-787764-6-iscsi is: [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:16Z', 'revision_number': 4, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '4f9ac680-4b89-4f65-bc06-6239f90f19f3', 'name': '', 'network_id': '584f2b3a-f3ea-4f7c-bcc9-711159cffa8a', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'mac_address': 'fa:16:3e:ae:a5:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_interface', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:16Z', 'updated_at': '2021-11-18T18:23:20Z', 'revision_number': 5, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'subnets': [{'id': 'cac1be0a-3676-49bd-8292-3623cc0fc8b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:28:39.579549 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2631a1b-c502-4f17-8b8f-7a24d4236e1e None None] New status for floating IP f68ff9ac-17c9-4d9e-b90b-0cf8d3efecc5: DOWN {{(pid=102691) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:28:40.070398 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee163cd8-e697-4c2b-8d9c-0b1e99c8ca01 req-bd108ac3-b1ea-46c0-9299-2d1fc64b8fb6 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:40.071756 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ee163cd8-e697-4c2b-8d9c-0b1e99c8ca01 req-bd108ac3-b1ea-46c0-9299-2d1fc64b8fb6 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0512717 Nov 18 18:28:40.119171 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ee163cd8-e697-4c2b-8d9c-0b1e99c8ca01 req-51dd3d04-d1d0-4761-9c81-a58873f62b1c tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/security-groups?id=7d840379-2de9-4453-883d-266a12b03984&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408778 Nov 18 18:28:40.189589 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:40.686631 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd757e2-27e7-4f68-a7ea-170f71433fb3 req-b84648d0-0b8b-4335-a2fd-5fa064ebe874 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:40.688026 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7cd757e2-27e7-4f68-a7ea-170f71433fb3 req-b84648d0-0b8b-4335-a2fd-5fa064ebe874 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.31 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 946 time: 0.0472867 Nov 18 18:28:40.784926 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-7cd757e2-27e7-4f68-a7ea-170f71433fb3 req-45d85fd1-533d-433e-93ce-3b2b8b89950d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Deleting port 85e36ba2-dd4d-47c9-b794-f9104af3235f {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:28:40.785271 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7cd757e2-27e7-4f68-a7ea-170f71433fb3 req-45d85fd1-533d-433e-93ce-3b2b8b89950d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:40.869984 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-7cd757e2-27e7-4f68-a7ea-170f71433fb3 req-45d85fd1-533d-433e-93ce-3b2b8b89950d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] For port 85e36ba2-dd4d-47c9-b794-f9104af3235f, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=85e36ba2-dd4d-47c9-b794-f9104af3235f,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:40.870337 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7cd757e2-27e7-4f68-a7ea-170f71433fb3 req-45d85fd1-533d-433e-93ce-3b2b8b89950d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:40.882888 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-7cd757e2-27e7-4f68-a7ea-170f71433fb3 req-45d85fd1-533d-433e-93ce-3b2b8b89950d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Calling delete_port for 85e36ba2-dd4d-47c9-b794-f9104af3235f owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:28:41.007862 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7cd757e2-27e7-4f68-a7ea-170f71433fb3 req-45d85fd1-533d-433e-93ce-3b2b8b89950d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:41.034634 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45d85fd1-533d-433e-93ce-3b2b8b89950d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event deleted for resources: {'Port': ['ID=85e36ba2-dd4d-47c9-b794-f9104af3235f,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:41.075308 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-7cd757e2-27e7-4f68-a7ea-170f71433fb3 req-45d85fd1-533d-433e-93ce-3b2b8b89950d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] No DVR routers for this DVR port 85e36ba2-dd4d-47c9-b794-f9104af3235f on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:28:41.078001 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-7cd757e2-27e7-4f68-a7ea-170f71433fb3 req-45d85fd1-533d-433e-93ce-3b2b8b89950d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:41.081512 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7cd757e2-27e7-4f68-a7ea-170f71433fb3 req-45d85fd1-533d-433e-93ce-3b2b8b89950d tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.31 "DELETE /v2.0/ports/85e36ba2-dd4d-47c9-b794-f9104af3235f HTTP/1.1" status: 204 len: 173 time: 0.3823457 Nov 18 18:28:41.081947 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'name': 'network-vif-deleted', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:28:41.084278 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef3c9c13-bbec-47f6-97cd-ff426bfc0cba" -d '{"events": [{"server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "name": "network-vif-deleted", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:28:41.120609 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:28:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cf8fe6d5-e9a2-4e8a-b99d-3358cfecd8d5 x-openstack-request-id: req-cf8fe6d5-e9a2-4e8a-b99d-3358cfecd8d5 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:28:41.120861 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2a40a10c-3bad-4a21-9793-fd4a8a6185dd", "name": "network-vif-deleted", "tag": "85e36ba2-dd4d-47c9-b794-f9104af3235f", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:28:41.121130 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-cf8fe6d5-e9a2-4e8a-b99d-3358cfecd8d5 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:28:41.121599 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2a40a10c-3bad-4a21-9793-fd4a8a6185dd', 'name': 'network-vif-deleted', 'tag': '85e36ba2-dd4d-47c9-b794-f9104af3235f', 'status': 'completed', 'code': 200} Nov 18 18:28:41.213961 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-55fe890e-f8b2-42fa-bdd1-67acb6297575 req-2dcbaf1e-bc73-4b55-92df-0a8d8b24c415 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "GET /v2.0/ports?device_id=2a40a10c-3bad-4a21-9793-fd4a8a6185dd HTTP/1.1" status: 200 len: 210 time: 0.0285654 Nov 18 18:28:42.268788 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44708) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:42.323606 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e05a5ce6-8c22-451d-bf5f-29f2fe33f903 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:42.348326 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e05a5ce6-8c22-451d-bf5f-29f2fe33f903 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:42.405794 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e05a5ce6-8c22-451d-bf5f-29f2fe33f903 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:42.408455 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-e05a5ce6-8c22-451d-bf5f-29f2fe33f903 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:42.409593 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-e05a5ce6-8c22-451d-bf5f-29f2fe33f903 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] 10.222.0.82 "DELETE /v2.0/security-groups/7d840379-2de9-4453-883d-266a12b03984 HTTP/1.1" status: 204 len: 168 time: 0.1398153 Nov 18 18:28:42.419185 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e05a5ce6-8c22-451d-bf5f-29f2fe33f903 tempest-TestShelveInstance-133118663 tempest-TestShelveInstance-133118663-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d840379-2de9-4453-883d-266a12b03984,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:42.451157 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44712) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:42.874073 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a853c757-abc2-433c-8679-66d956edaafd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-499121'] for router_interface, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:43.105270 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-a853c757-abc2-433c-8679-66d956edaafd admin admin] Deleting port 4f9ac680-4b89-4f65-bc06-6239f90f19f3 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:28:43.105600 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a853c757-abc2-433c-8679-66d956edaafd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:43.179045 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-a853c757-abc2-433c-8679-66d956edaafd admin admin] For port 4f9ac680-4b89-4f65-bc06-6239f90f19f3, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=4f9ac680-4b89-4f65-bc06-6239f90f19f3,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:43.179316 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a853c757-abc2-433c-8679-66d956edaafd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:43.191678 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-a853c757-abc2-433c-8679-66d956edaafd admin admin] Calling delete_port for 4f9ac680-4b89-4f65-bc06-6239f90f19f3 owned by network:router_interface {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:28:43.367368 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a853c757-abc2-433c-8679-66d956edaafd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:43.392695 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a853c757-abc2-433c-8679-66d956edaafd admin admin] Pushing event deleted for resources: {'Port': ['ID=4f9ac680-4b89-4f65-bc06-6239f90f19f3,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:43.555295 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a853c757-abc2-433c-8679-66d956edaafd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1772491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-498973'] for router_interface, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:43.984975 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a853c757-abc2-433c-8679-66d956edaafd admin admin] Router 0f9804e2-48c3-4648-b16c-33eeec3a9305 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:28:44.085129 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a853c757-abc2-433c-8679-66d956edaafd admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:28:44.090448 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-a853c757-abc2-433c-8679-66d956edaafd admin admin] 10.222.0.82 "PUT /v2.0/routers/0f9804e2-48c3-4648-b16c-33eeec3a9305/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6381721 Nov 18 18:28:44.093034 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44716) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:44.093788 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39f983e6-f947-4698-bbbb-1a7c79b08f6b None None] Sync routers for ids ['0f9804e2-48c3-4648-b16c-33eeec3a9305'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:28:44.104076 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39f983e6-f947-4698-bbbb-1a7c79b08f6b None None] Routers {'0f9804e2-48c3-4648-b16c-33eeec3a9305'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:28:44.104712 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-39f983e6-f947-4698-bbbb-1a7c79b08f6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:28:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['0f9804e2-48c3-4648-b16c-33eeec3a9305'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:44.195158 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Publish callbacks [] for router, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:44.209896 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-39f983e6-f947-4698-bbbb-1a7c79b08f6b None None] Set router 0f9804e2-48c3-4648-b16c-33eeec3a9305 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:28:44.294932 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:44.345287 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Deleting port 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:28:44.345510 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:44.385827 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-39f983e6-f947-4698-bbbb-1a7c79b08f6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:28:43Z', 'revision_number': 5, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port': {'id': '70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:4d:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:23:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:44.417237 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39f983e6-f947-4698-bbbb-1a7c79b08f6b None None] Checking router: 0f9804e2-48c3-4648-b16c-33eeec3a9305 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:28:44.426654 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] For port 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:44.427582 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:44.427820 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39f983e6-f947-4698-bbbb-1a7c79b08f6b None None] Routers {'0f9804e2-48c3-4648-b16c-33eeec3a9305'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:28:44.428459 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-39f983e6-f947-4698-bbbb-1a7c79b08f6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:28:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['0f9804e2-48c3-4648-b16c-33eeec3a9305'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:44.440408 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Calling delete_port for 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f owned by network:router_gateway {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:28:44.513522 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-39f983e6-f947-4698-bbbb-1a7c79b08f6b None None] Set router 0f9804e2-48c3-4648-b16c-33eeec3a9305 gateway port host: None {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:28:44.564650 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-39f983e6-f947-4698-bbbb-1a7c79b08f6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:28:44Z', 'revision_number': 6, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port_host': None}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:44.593919 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39f983e6-f947-4698-bbbb-1a7c79b08f6b None None] The sync data for ids ['0f9804e2-48c3-4648-b16c-33eeec3a9305'] in dv-cinder-787764-6-iscsi is: [{'id': '0f9804e2-48c3-4648-b16c-33eeec3a9305', 'name': 'tempest-TestShelveInstance-40725722-router', 'tenant_id': '029e580af1e3498aa00c86f5ce660a80', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:13Z', 'updated_at': '2021-11-18T18:28:44Z', 'revision_number': 6, 'project_id': '029e580af1e3498aa00c86f5ce660a80', 'gw_port_host': None}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:28:44.602643 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:44.632821 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Pushing event deleted for resources: {'Port': ['ID=70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:44.690937 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-500475'] for router_gateway, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:44.779112 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-430336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-557'] for router, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:44.781267 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:44.782334 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 85e36ba2-dd4d-47c9-b794-f9104af3235f no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:28:44.802315 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: 85e36ba2-dd4d-47c9-b794-f9104af3235f {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:28:44.802665 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 85e36ba2-dd4d-47c9-b794-f9104af3235f not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:28:44.822918 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-430347'] for router, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:44.823488 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0f9804e2-48c3-4648-b16c-33eeec3a9305 {{(pid=102689) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 18:28:44.828360 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] Publish callbacks [] for router, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:44.829572 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-44fb5b82-be26-43e7-aa56-bcd17c255aa6 admin admin] 10.222.0.82 "DELETE /v2.0/routers/0f9804e2-48c3-4648-b16c-33eeec3a9305 HTTP/1.1" status: 204 len: 168 time: 0.7356226 Nov 18 18:28:44.832159 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44718) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:44.878302 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_v2 [None req-2c391b72-2930-4ec2-8147-9f37d22fb84c admin admin] Deleting subnet cac1be0a-3676-49bd-8292-3623cc0fc8b1 {{(pid=102689) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:28:44.881245 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2c391b72-2930-4ec2-8147-9f37d22fb84c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:44.915957 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2c391b72-2930-4ec2-8147-9f37d22fb84c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12724830'] for subnet, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.030813 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2c391b72-2930-4ec2-8147-9f37d22fb84c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.080106 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2c391b72-2930-4ec2-8147-9f37d22fb84c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12723963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14479099'] for subnet, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.105357 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c391b72-2930-4ec2-8147-9f37d22fb84c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cac1be0a-3676-49bd-8292-3623cc0fc8b1,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:45.108905 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2c391b72-2930-4ec2-8147-9f37d22fb84c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.112147 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-2c391b72-2930-4ec2-8147-9f37d22fb84c admin admin] 10.222.0.82 "DELETE /v2.0/subnets/cac1be0a-3676-49bd-8292-3623cc0fc8b1 HTTP/1.1" status: 204 len: 168 time: 0.2790241 Nov 18 18:28:45.114784 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44722) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:45.116430 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1a10a8b-4bb9-4c93-bbb5-9d73a4fc04ba None None] Network 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:28:45.186160 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.236999 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Deleting port 23520980-2021-4b45-9862-72ac55d89059 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:28:45.237337 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.302120 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] For port 23520980-2021-4b45-9862-72ac55d89059, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=23520980-2021-4b45-9862-72ac55d89059,segment=NetworkSegment(0bd6ae3c-7404-429f-9807-6c61fe30f185),segment_id=0bd6ae3c-7404-429f-9807-6c61fe30f185)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:45.302432 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.314223 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Calling delete_port for 23520980-2021-4b45-9862-72ac55d89059 owned by network:dhcp {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:28:45.358183 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15f50057-4582-416b-b8e0-95be70701ab4 None None] DHCP port deletion for 584f2b3a-f3ea-4f7c-bcc9-711159cffa8a request from dv-cinder-787764-6-iscsi {{(pid=102690) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 18:28:45.397207 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.405939 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-15f50057-4582-416b-b8e0-95be70701ab4 None None] Deleting port 23520980-2021-4b45-9862-72ac55d89059 {{(pid=102690) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:28:45.406305 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-15f50057-4582-416b-b8e0-95be70701ab4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.422722 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Pushing event deleted for resources: {'Port': ['ID=23520980-2021-4b45-9862-72ac55d89059,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:45.427046 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] No DVR routers for this DVR port 23520980-2021-4b45-9862-72ac55d89059 on host dv-cinder-787764-6-iscsi {{(pid=102688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:28:45.452316 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:45.452598 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:45.452947 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:45.453286 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:45.453624 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:45.453963 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:45.454295 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:45.454630 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:45.454963 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:45.455292 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:45.455621 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:45.455968 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:28:45.476927 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-15f50057-4582-416b-b8e0-95be70701ab4 None None] For port 23520980-2021-4b45-9862-72ac55d89059, host dv-cinder-787764-6-iscsi, got binding levels [] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:45.477342 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-15f50057-4582-416b-b8e0-95be70701ab4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.490332 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-15f50057-4582-416b-b8e0-95be70701ab4 None None] Calling delete_port for 23520980-2021-4b45-9862-72ac55d89059 owned by network:dhcp {{(pid=102690) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:28:45.493092 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.ipam_backend_mixin [None req-15f50057-4582-416b-b8e0-95be70701ab4 None None] Port 23520980-2021-4b45-9862-72ac55d89059 was not found and therefore no delete operation was performed {{(pid=102690) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 18 18:28:45.494311 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-15f50057-4582-416b-b8e0-95be70701ab4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596'] for port, after_delete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.513062 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.520562 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15f50057-4582-416b-b8e0-95be70701ab4 None None] Pushing event deleted for resources: {'Port': ['ID=23520980-2021-4b45-9862-72ac55d89059,revision_number=None']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:45.522048 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15f50057-4582-416b-b8e0-95be70701ab4 None None] No DVR routers for this DVR port 23520980-2021-4b45-9862-72ac55d89059 on host dv-cinder-787764-6-iscsi {{(pid=102690) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:28:45.540652 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['584f2b3a-f3ea-4f7c-bcc9-711159cffa8a']}} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:45.551097 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0bd6ae3c-7404-429f-9807-6c61fe30f185') {'for_net_delete': True} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:45.551402 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0bd6ae3c-7404-429f-9807-6c61fe30f185') {} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:45.561303 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14253766'] for segment, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.576053 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.582313 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Releasing vlan 1345 on physical network physnet1 to pool {{(pid=102688) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:28:45.582711 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-13993202'] for segment, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: Traceback (most recent call last): Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: timer() Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: cb(*args, **kw) Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: return func(*args, **kwargs) Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: self._notify() Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: self.callback(batched_events) Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: event.method(event) Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: return f(self, *a, **k) Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._get(url).json() Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: return self.request(url, 'GET', **kwargs) Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:28:45.584448 dv-cinder-787764-6-iscsi neutron-server[102688]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:28:45.644024 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.649490 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:45.653333 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] 10.222.0.82 "DELETE /v2.0/networks/584f2b3a-f3ea-4f7c-bcc9-711159cffa8a HTTP/1.1" status: 204 len: 168 time: 0.5369539 Nov 18 18:28:45.656248 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44726) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:45.664148 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4364fa5-8cfe-4739-b20d-cb30549747f3 admin admin] Pushing event deleted for resources: {'Network': ['ID=584f2b3a-f3ea-4f7c-bcc9-711159cffa8a,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:45.987888 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4dbae1a4-2403-4179-acc5-6355ddc725da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-499121'] for router_interface, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:46.228213 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-4dbae1a4-2403-4179-acc5-6355ddc725da admin admin] Deleting port aa9da10c-d74d-4dc3-99c9-055b24cc4110 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:28:46.228541 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4dbae1a4-2403-4179-acc5-6355ddc725da admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:46.302304 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-4dbae1a4-2403-4179-acc5-6355ddc725da admin admin] For port aa9da10c-d74d-4dc3-99c9-055b24cc4110, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=aa9da10c-d74d-4dc3-99c9-055b24cc4110,segment=NetworkSegment(184d64c9-8049-408c-9e5a-54f72d13ce49),segment_id=184d64c9-8049-408c-9e5a-54f72d13ce49)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:46.302677 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4dbae1a4-2403-4179-acc5-6355ddc725da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:46.315190 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-4dbae1a4-2403-4179-acc5-6355ddc725da admin admin] Calling delete_port for aa9da10c-d74d-4dc3-99c9-055b24cc4110 owned by network:router_interface {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:28:46.436729 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 4f9ac680-4b89-4f65-bc06-6239f90f19f3 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:28:46.456915 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 4f9ac680-4b89-4f65-bc06-6239f90f19f3 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:28:46.457269 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 4f9ac680-4b89-4f65-bc06-6239f90f19f3 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:28:46.457693 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 23520980-2021-4b45-9862-72ac55d89059 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:28:46.473249 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:28:46.476256 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 23520980-2021-4b45-9862-72ac55d89059 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:28:46.476600 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 23520980-2021-4b45-9862-72ac55d89059 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:28:46.477017 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:28:46.487178 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4dbae1a4-2403-4179-acc5-6355ddc725da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:46.495446 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:28:46.495804 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 70c8ebeb-e9e4-4c9a-9de8-afc8a7faac9f not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:28:46.512101 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dbae1a4-2403-4179-acc5-6355ddc725da admin admin] Pushing event deleted for resources: {'Port': ['ID=aa9da10c-d74d-4dc3-99c9-055b24cc4110,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:46.903418 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4dbae1a4-2403-4179-acc5-6355ddc725da admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1772491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-498973'] for router_interface, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:47.110364 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4dbae1a4-2403-4179-acc5-6355ddc725da admin admin] Router 13c2661f-fac1-483e-824d-3d28144d3cb6 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:28:47.212026 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4dbae1a4-2403-4179-acc5-6355ddc725da admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:28:47.217826 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-4dbae1a4-2403-4179-acc5-6355ddc725da admin admin] 10.222.0.82 "PUT /v2.0/routers/13c2661f-fac1-483e-824d-3d28144d3cb6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5605648 Nov 18 18:28:47.220597 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44728) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:47.221538 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-067ac823-8db3-4885-900a-e5ef64226ff3 None None] Sync routers for ids ['13c2661f-fac1-483e-824d-3d28144d3cb6'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:28:47.231735 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-067ac823-8db3-4885-900a-e5ef64226ff3 None None] Routers {'13c2661f-fac1-483e-824d-3d28144d3cb6'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:28:47.232370 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-067ac823-8db3-4885-900a-e5ef64226ff3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:28:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['13c2661f-fac1-483e-824d-3d28144d3cb6'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:47.322782 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Publish callbacks [] for router, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:47.334108 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-067ac823-8db3-4885-900a-e5ef64226ff3 None None] Set router 13c2661f-fac1-483e-824d-3d28144d3cb6 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:28:47.422912 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:47.476001 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Deleting port 7338786c-8201-4395-989f-2f80d260bb87 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:28:47.476345 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:47.507757 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-067ac823-8db3-4885-900a-e5ef64226ff3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'name': 'tempest-TestShelveInstance-820423817-router', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65'}], 'enable_snat': True}, 'gw_port_id': '7338786c-8201-4395-989f-2f80d260bb87', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:18Z', 'updated_at': '2021-11-18T18:28:46Z', 'revision_number': 5, 'project_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'gw_port': {'id': '7338786c-8201-4395-989f-2f80d260bb87', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:6c:fe:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:23:19Z', 'updated_at': '2021-11-18T18:23:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:47.537790 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-067ac823-8db3-4885-900a-e5ef64226ff3 None None] Checking router: 13c2661f-fac1-483e-824d-3d28144d3cb6 for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:28:47.546179 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-067ac823-8db3-4885-900a-e5ef64226ff3 None None] Routers {'13c2661f-fac1-483e-824d-3d28144d3cb6'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:28:47.546771 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-067ac823-8db3-4885-900a-e5ef64226ff3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:28:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['13c2661f-fac1-483e-824d-3d28144d3cb6'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:47.554156 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] For port 7338786c-8201-4395-989f-2f80d260bb87, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=7338786c-8201-4395-989f-2f80d260bb87,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:47.554525 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:47.567570 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Calling delete_port for 7338786c-8201-4395-989f-2f80d260bb87 owned by network:router_gateway {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:28:47.627801 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-067ac823-8db3-4885-900a-e5ef64226ff3 None None] Set router 13c2661f-fac1-483e-824d-3d28144d3cb6 gateway port host: None {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:28:47.680278 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-067ac823-8db3-4885-900a-e5ef64226ff3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'name': 'tempest-TestShelveInstance-820423817-router', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:18Z', 'updated_at': '2021-11-18T18:28:47Z', 'revision_number': 6, 'project_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'gw_port_host': None}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:47.706676 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-067ac823-8db3-4885-900a-e5ef64226ff3 None None] The sync data for ids ['13c2661f-fac1-483e-824d-3d28144d3cb6'] in dv-cinder-787764-6-iscsi is: [{'id': '13c2661f-fac1-483e-824d-3d28144d3cb6', 'name': 'tempest-TestShelveInstance-820423817-router', 'tenant_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:23:18Z', 'updated_at': '2021-11-18T18:28:47Z', 'revision_number': 6, 'project_id': 'c8e008dffadc4a8a84dc0bc8061ae697', 'gw_port_host': None}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:28:47.732227 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:47.756111 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Pushing event deleted for resources: {'Port': ['ID=7338786c-8201-4395-989f-2f80d260bb87,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:47.820676 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-500475'] for router_gateway, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:47.908349 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-430336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-557'] for router, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:47.910454 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:47.951859 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-430347'] for router, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:47.952366 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 13c2661f-fac1-483e-824d-3d28144d3cb6 {{(pid=102688) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 18:28:47.956610 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] Publish callbacks [] for router, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:47.957740 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-34c1281f-985b-44be-87ce-9ffd2dad517b admin admin] 10.222.0.82 "DELETE /v2.0/routers/13c2661f-fac1-483e-824d-3d28144d3cb6 HTTP/1.1" status: 204 len: 168 time: 0.7361512 Nov 18 18:28:47.960431 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44730) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:48.006770 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_v2 [None req-a1d1c7a2-5025-421d-a61a-906368e34623 admin admin] Deleting subnet cd3ac6d9-a01b-4af0-8cf6-bc22a308025d {{(pid=102688) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:28:48.009626 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a1d1c7a2-5025-421d-a61a-906368e34623 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.042664 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a1d1c7a2-5025-421d-a61a-906368e34623 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14253791'] for subnet, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.121300 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a1d1c7a2-5025-421d-a61a-906368e34623 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.172827 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a1d1c7a2-5025-421d-a61a-906368e34623 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-13993132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14505899'] for subnet, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.201621 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1d1c7a2-5025-421d-a61a-906368e34623 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cd3ac6d9-a01b-4af0-8cf6-bc22a308025d,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:48.203473 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a1d1c7a2-5025-421d-a61a-906368e34623 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.207406 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c524a57d-c7da-439f-8311-1ffc92d2e2c6 None None] Network f961cc50-11d6-4545-80f0-cb15e6b8881d requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:28:48.208039 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a1d1c7a2-5025-421d-a61a-906368e34623 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/cd3ac6d9-a01b-4af0-8cf6-bc22a308025d HTTP/1.1" status: 204 len: 168 time: 0.2457800 Nov 18 18:28:48.209717 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44732) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:48.278134 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.330236 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Deleting port b3ec7111-b763-4f53-a3c8-7f676200679b {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:28:48.330576 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.396796 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] For port b3ec7111-b763-4f53-a3c8-7f676200679b, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=b3ec7111-b763-4f53-a3c8-7f676200679b,segment=NetworkSegment(184d64c9-8049-408c-9e5a-54f72d13ce49),segment_id=184d64c9-8049-408c-9e5a-54f72d13ce49)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:48.397097 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.409562 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Calling delete_port for b3ec7111-b763-4f53-a3c8-7f676200679b owned by network:dhcp {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:28:48.456841 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-085505a8-bfec-4d2b-90f0-3030a5145bca None None] DHCP port deletion for f961cc50-11d6-4545-80f0-cb15e6b8881d request from dv-cinder-787764-6-iscsi {{(pid=102690) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 18:28:48.500016 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.517057 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device b3ec7111-b763-4f53-a3c8-7f676200679b no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:28:48.531203 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Pushing event deleted for resources: {'Port': ['ID=b3ec7111-b763-4f53-a3c8-7f676200679b,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:48.534633 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] No DVR routers for this DVR port b3ec7111-b763-4f53-a3c8-7f676200679b on host dv-cinder-787764-6-iscsi {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:28:48.541305 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-085505a8-bfec-4d2b-90f0-3030a5145bca None None] Deleting port b3ec7111-b763-4f53-a3c8-7f676200679b {{(pid=102690) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:28:48.541681 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-085505a8-bfec-4d2b-90f0-3030a5145bca None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.545373 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: b3ec7111-b763-4f53-a3c8-7f676200679b {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:28:48.545717 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device b3ec7111-b763-4f53-a3c8-7f676200679b not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:28:48.546128 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 7338786c-8201-4395-989f-2f80d260bb87 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:28:48.576607 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 7338786c-8201-4395-989f-2f80d260bb87 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:28:48.576960 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 7338786c-8201-4395-989f-2f80d260bb87 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:28:48.577386 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device aa9da10c-d74d-4dc3-99c9-055b24cc4110 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:28:48.605230 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.606506 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: aa9da10c-d74d-4dc3-99c9-055b24cc4110 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:28:48.606858 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device aa9da10c-d74d-4dc3-99c9-055b24cc4110 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:28:48.625541 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f961cc50-11d6-4545-80f0-cb15e6b8881d']}} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:48.634775 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '184d64c9-8049-408c-9e5a-54f72d13ce49') {'for_net_delete': True} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:48.635065 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '184d64c9-8049-408c-9e5a-54f72d13ce49') {} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:48.645115 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12724807'] for segment, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.649829 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-085505a8-bfec-4d2b-90f0-3030a5145bca None None] For port b3ec7111-b763-4f53-a3c8-7f676200679b, host dv-cinder-787764-6-iscsi, got binding levels [] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:48.650239 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-085505a8-bfec-4d2b-90f0-3030a5145bca None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.659694 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.664353 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-085505a8-bfec-4d2b-90f0-3030a5145bca None None] Calling delete_port for b3ec7111-b763-4f53-a3c8-7f676200679b owned by network:dhcp {{(pid=102690) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:28:48.667212 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Releasing vlan 1330 on physical network physnet1 to pool {{(pid=102689) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:28:48.667394 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.ipam_backend_mixin [None req-085505a8-bfec-4d2b-90f0-3030a5145bca None None] Port b3ec7111-b763-4f53-a3c8-7f676200679b was not found and therefore no delete operation was performed {{(pid=102690) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 18 18:28:48.668033 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12723877'] for segment, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.668506 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-085505a8-bfec-4d2b-90f0-3030a5145bca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596'] for port, after_delete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: Traceback (most recent call last): Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: timer() Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: cb(*args, **kw) Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: return func(*args, **kwargs) Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: self._notify() Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: self.callback(batched_events) Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: event.method(event) Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: return f(self, *a, **k) Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._get(url).json() Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: return self.request(url, 'GET', **kwargs) Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:28:48.670418 dv-cinder-787764-6-iscsi neutron-server[102689]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:28:48.693523 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-085505a8-bfec-4d2b-90f0-3030a5145bca None None] Pushing event deleted for resources: {'Port': ['ID=b3ec7111-b763-4f53-a3c8-7f676200679b,revision_number=None']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:48.697053 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-085505a8-bfec-4d2b-90f0-3030a5145bca None None] No DVR routers for this DVR port b3ec7111-b763-4f53-a3c8-7f676200679b on host dv-cinder-787764-6-iscsi {{(pid=102690) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:28:48.740929 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.750780 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.756497 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] 10.222.0.82 "DELETE /v2.0/networks/f961cc50-11d6-4545-80f0-cb15e6b8881d HTTP/1.1" status: 204 len: 168 time: 0.5427268 Nov 18 18:28:48.768409 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f7544a-5402-4f87-9855-abd4e9cc7536 admin admin] Pushing event deleted for resources: {'Network': ['ID=f961cc50-11d6-4545-80f0-cb15e6b8881d,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:48.866762 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44736) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:48.905914 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-69a74bc3-975e-4de8-871c-fb9aab5f46ab admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=029e580af1e3498aa00c86f5ce660a80&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0379496 Nov 18 18:28:48.908213 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44740) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:48.954725 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-29c0a164-8d60-4be9-9945-6ec129ae459f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:48.975231 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-29c0a164-8d60-4be9-9945-6ec129ae459f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:49.024434 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-29c0a164-8d60-4be9-9945-6ec129ae459f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:49.027182 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-29c0a164-8d60-4be9-9945-6ec129ae459f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:49.028419 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-29c0a164-8d60-4be9-9945-6ec129ae459f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5557e29b-5cf1-496c-aaf9-7966b2aa28c3 HTTP/1.1" status: 204 len: 168 time: 0.1192887 Nov 18 18:28:49.035916 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29c0a164-8d60-4be9-9945-6ec129ae459f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5557e29b-5cf1-496c-aaf9-7966b2aa28c3,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:49.326932 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44746) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:49.367879 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-5d2552f0-57cd-4acf-981c-f984068dc5f0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c8e008dffadc4a8a84dc0bc8061ae697&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0376477 Nov 18 18:28:49.368174 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44748) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:49.412899 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c25a621e-8949-420c-9250-cfb219d7dd09 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:49.433423 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c25a621e-8949-420c-9250-cfb219d7dd09 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:49.479097 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c25a621e-8949-420c-9250-cfb219d7dd09 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:49.482243 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c25a621e-8949-420c-9250-cfb219d7dd09 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:49.483468 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-c25a621e-8949-420c-9250-cfb219d7dd09 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/21f0a312-3697-4f3e-a4f6-1217a7152653 HTTP/1.1" status: 204 len: 168 time: 0.1143861 Nov 18 18:28:49.490855 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25a621e-8949-420c-9250-cfb219d7dd09 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=21f0a312-3697-4f3e-a4f6-1217a7152653,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:51.157511 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:55.858426 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a209a936-a83c-4290-920d-3deee9a7d4a8 req-6d6090fe-518d-47d9-9495-62a4bd0384bf tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:55.859828 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a209a936-a83c-4290-920d-3deee9a7d4a8 req-6d6090fe-518d-47d9-9495-62a4bd0384bf tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 945 time: 0.0492914 Nov 18 18:28:55.906039 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a209a936-a83c-4290-920d-3deee9a7d4a8 req-8c8757dd-f5e1-4d88-88ed-71b16e35fd28 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=85be819a-494b-4bb1-8456-793f13c276c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401626 Nov 18 18:28:57.020209 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7123af85-cf00-4d1d-891b-1ca5d4245275 req-7093bb1d-8860-402d-a729-7c5f0df4b1f1 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:57.021581 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7123af85-cf00-4d1d-891b-1ca5d4245275 req-7093bb1d-8860-402d-a729-7c5f0df4b1f1 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 945 time: 0.0474257 Nov 18 18:28:57.066636 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-7123af85-cf00-4d1d-891b-1ca5d4245275 req-cc0f3cf9-8f26-4297-881b-91633423ff48 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=85be819a-494b-4bb1-8456-793f13c276c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392315 Nov 18 18:28:57.960944 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2726bc59-f369-4211-961f-d5e809a798b9 req-9cfd2ac0-54eb-4fc6-acc2-77b7c96ec3fd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:57.962364 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2726bc59-f369-4211-961f-d5e809a798b9 req-9cfd2ac0-54eb-4fc6-acc2-77b7c96ec3fd tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.31 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 945 time: 0.0495915 Nov 18 18:28:58.051594 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Deleting port ffe1f693-e5ac-4652-9079-c7b4eebd4317 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:28:58.052314 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:58.148996 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] For port ffe1f693-e5ac-4652-9079-c7b4eebd4317, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ffe1f693-e5ac-4652-9079-c7b4eebd4317,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:28:58.149355 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:58.233289 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e2b8c8a-68db-4945-9bd3-50a7a21c2a1f req-63de0375-7ac4-4aa1-a24c-5cfb33045027 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:28:58.234755 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e2b8c8a-68db-4945-9bd3-50a7a21c2a1f req-63de0375-7ac4-4aa1-a24c-5cfb33045027 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/ports?device_id=7ba78d1f-a71a-45bf-a563-918c2a5fceca HTTP/1.1" status: 200 len: 945 time: 0.1001945 Nov 18 18:28:58.357895 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e2b8c8a-68db-4945-9bd3-50a7a21c2a1f req-5ccd4041-d3c6-4dfd-8a9f-e1f19120a0fe tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups?id=85be819a-494b-4bb1-8456-793f13c276c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1147547 Nov 18 18:28:58.380938 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:58.381303 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:58.381618 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Floating IP 36abcff2-4b6b-4296-a87c-ed3ece2c4391 disassociated. External IP: 172.27.1.83, port: ffe1f693-e5ac-4652-9079-c7b4eebd4317. Nov 18 18:28:58.382204 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Calling delete_port for ffe1f693-e5ac-4652-9079-c7b4eebd4317 owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:28:58.507554 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:58.533764 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event deleted for resources: {'Port': ['ID=ffe1f693-e5ac-4652-9079-c7b4eebd4317,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:58.646031 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Router 9674107a-752c-42c3-a133-60c85d951af8 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:28:58.750627 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:28:58.763974 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae483ca4-1d3c-41a0-ae15-8fcccb63a8db None None] Sync routers for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:28:58.774090 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae483ca4-1d3c-41a0-ae15-8fcccb63a8db None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:28:58.774701 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-ae483ca4-1d3c-41a0-ae15-8fcccb63a8db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:28:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:58.791777 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] No DVR routers for this DVR port ffe1f693-e5ac-4652-9079-c7b4eebd4317 on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:28:58.794384 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:58.798347 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-2726bc59-f369-4211-961f-d5e809a798b9 req-27ede4ac-ef29-48ae-ae35-1e2e3e095281 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.31 "DELETE /v2.0/ports/ffe1f693-e5ac-4652-9079-c7b4eebd4317 HTTP/1.1" status: 204 len: 173 time: 0.8270247 Nov 18 18:28:58.798791 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'name': 'network-vif-deleted', 'tag': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:28:58.801054 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee097bf5-8956-4387-8807-732b07d63c68" -d '{"events": [{"server_uuid": "7ba78d1f-a71a-45bf-a563-918c2a5fceca", "name": "network-vif-deleted", "tag": "ffe1f693-e5ac-4652-9079-c7b4eebd4317"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:28:58.840554 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:28:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c2e3625-2559-4ec1-b36c-7127a7b85dd5 x-openstack-request-id: req-0c2e3625-2559-4ec1-b36c-7127a7b85dd5 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:28:58.840855 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ba78d1f-a71a-45bf-a563-918c2a5fceca", "name": "network-vif-deleted", "tag": "ffe1f693-e5ac-4652-9079-c7b4eebd4317", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:28:58.841116 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-0c2e3625-2559-4ec1-b36c-7127a7b85dd5 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:28:58.842028 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ba78d1f-a71a-45bf-a563-918c2a5fceca', 'name': 'network-vif-deleted', 'tag': 'ffe1f693-e5ac-4652-9079-c7b4eebd4317', 'status': 'completed', 'code': 200} Nov 18 18:28:59.023629 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-ae483ca4-1d3c-41a0-ae15-8fcccb63a8db None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:28:59.315259 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-ae483ca4-1d3c-41a0-ae15-8fcccb63a8db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:38Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:59.347975 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae483ca4-1d3c-41a0-ae15-8fcccb63a8db None None] Checking router: 9674107a-752c-42c3-a133-60c85d951af8 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:28:59.360276 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae483ca4-1d3c-41a0-ae15-8fcccb63a8db None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:28:59.360885 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-ae483ca4-1d3c-41a0-ae15-8fcccb63a8db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:28:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:59.444195 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44806) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:59.483501 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-ae483ca4-1d3c-41a0-ae15-8fcccb63a8db None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:28:59.498451 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2e8f795a-5242-4c88-9365-4a50eae6cc6e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:59.521874 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2e8f795a-5242-4c88-9365-4a50eae6cc6e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:59.570307 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2e8f795a-5242-4c88-9365-4a50eae6cc6e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:59.572979 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2e8f795a-5242-4c88-9365-4a50eae6cc6e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:59.574265 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-2e8f795a-5242-4c88-9365-4a50eae6cc6e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "DELETE /v2.0/security-groups/85be819a-494b-4bb1-8456-793f13c276c5 HTTP/1.1" status: 204 len: 168 time: 0.1285129 Nov 18 18:28:59.577715 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44808) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:59.584046 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e8f795a-5242-4c88-9365-4a50eae6cc6e tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=85be819a-494b-4bb1-8456-793f13c276c5,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:28:59.598522 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.api.v2.resource [None req-71e5478f-a9c6-416b-8db1-bd1691ec1633 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] show failed (client error): The resource could not be found. Nov 18 18:28:59.599668 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-71e5478f-a9c6-416b-8db1-bd1691ec1633 tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "GET /v2.0/security-groups/85be819a-494b-4bb1-8456-793f13c276c5 HTTP/1.1" status: 404 len: 347 time: 0.0202751 Nov 18 18:28:59.602464 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44810) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:28:59.688114 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-ae483ca4-1d3c-41a0-ae15-8fcccb63a8db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:38Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:28:59.719561 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae483ca4-1d3c-41a0-ae15-8fcccb63a8db None None] The sync data for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi is: [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:26Z', 'revision_number': 4, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '82ade1e6-a8c1-462a-97bb-16499ada8f89', 'name': '', 'network_id': 'f2a08e65-1c6c-43fe-a019-78643e62bd9f', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'mac_address': 'fa:16:3e:18:70:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:21Z', 'updated_at': '2021-11-18T18:21:38Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'subnets': [{'id': '53535ce7-7c2a-450f-87e4-d092908ff080', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:28:59.725013 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-1162852e-6382-410d-877b-50977c32869b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Deleting port 38277be6-23cb-47a3-afcd-fbc96dd1ce1b {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:28:59.725383 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1162852e-6382-410d-877b-50977c32869b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:59.801859 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1162852e-6382-410d-877b-50977c32869b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:59.802188 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1162852e-6382-410d-877b-50977c32869b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:59.813680 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-1162852e-6382-410d-877b-50977c32869b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Calling delete_port for 38277be6-23cb-47a3-afcd-fbc96dd1ce1b owned by network:floatingip {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:28:59.944960 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fda0d30-775c-4879-b1a5-0c3ae034f734 None None] New status for floating IP 36abcff2-4b6b-4296-a87c-ed3ece2c4391: DOWN {{(pid=102691) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:28:59.949162 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1162852e-6382-410d-877b-50977c32869b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:28:59.977229 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1162852e-6382-410d-877b-50977c32869b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Pushing event deleted for resources: {'Port': ['ID=38277be6-23cb-47a3-afcd-fbc96dd1ce1b,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:00.045835 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1162852e-6382-410d-877b-50977c32869b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks [] for floatingip, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:00.048951 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-1162852e-6382-410d-877b-50977c32869b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:00.050138 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-1162852e-6382-410d-877b-50977c32869b tempest-AttachVolumeTestJSON-909250366 tempest-AttachVolumeTestJSON-909250366-project] 10.222.0.82 "DELETE /v2.0/floatingips/36abcff2-4b6b-4296-a87c-ed3ece2c4391 HTTP/1.1" status: 204 len: 168 time: 0.4467881 Nov 18 18:29:02.815058 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device ffe1f693-e5ac-4652-9079-c7b4eebd4317 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:29:02.835010 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: ffe1f693-e5ac-4652-9079-c7b4eebd4317 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:29:02.835354 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device ffe1f693-e5ac-4652-9079-c7b4eebd4317 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:29:03.554533 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44844) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:03.994087 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-ac9aa762-ed49-4381-9f22-41d416499f6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:04.063789 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-aa1f07a8-b597-498d-8a00-7344b962b20f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-499121'] for router_interface, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:04.532146 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-aa1f07a8-b597-498d-8a00-7344b962b20f admin admin] Deleting port 82ade1e6-a8c1-462a-97bb-16499ada8f89 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:29:04.532477 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-aa1f07a8-b597-498d-8a00-7344b962b20f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:04.609195 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-aa1f07a8-b597-498d-8a00-7344b962b20f admin admin] For port 82ade1e6-a8c1-462a-97bb-16499ada8f89, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=82ade1e6-a8c1-462a-97bb-16499ada8f89,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:29:04.609895 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-aa1f07a8-b597-498d-8a00-7344b962b20f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:04.621346 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-aa1f07a8-b597-498d-8a00-7344b962b20f admin admin] Calling delete_port for 82ade1e6-a8c1-462a-97bb-16499ada8f89 owned by network:router_interface {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:29:04.795463 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-aa1f07a8-b597-498d-8a00-7344b962b20f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:04.819894 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa1f07a8-b597-498d-8a00-7344b962b20f admin admin] Pushing event deleted for resources: {'Port': ['ID=82ade1e6-a8c1-462a-97bb-16499ada8f89,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:04.981396 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-aa1f07a8-b597-498d-8a00-7344b962b20f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1772491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-498973'] for router_interface, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:05.185980 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa1f07a8-b597-498d-8a00-7344b962b20f admin admin] Router 9674107a-752c-42c3-a133-60c85d951af8 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:29:05.286568 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa1f07a8-b597-498d-8a00-7344b962b20f admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:29:05.291510 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-aa1f07a8-b597-498d-8a00-7344b962b20f admin admin] 10.222.0.82 "PUT /v2.0/routers/9674107a-752c-42c3-a133-60c85d951af8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7359002 Nov 18 18:29:05.294023 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44848) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:05.297437 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a567e3e0-0697-4354-b8fe-ce3ce8d0b78b None None] Sync routers for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:29:05.306793 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a567e3e0-0697-4354-b8fe-ce3ce8d0b78b None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:29:05.307387 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-a567e3e0-0697-4354-b8fe-ce3ce8d0b78b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:28:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:05.394431 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Publish callbacks [] for router, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:05.410997 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-a567e3e0-0697-4354-b8fe-ce3ce8d0b78b None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:29:05.492986 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:05.542437 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Deleting port 9796f4fb-9636-4217-a66f-0e1f422636dd {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:29:05.542769 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:05.588689 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-a567e3e0-0697-4354-b8fe-ce3ce8d0b78b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:29:04Z', 'revision_number': 5, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port': {'id': '9796f4fb-9636-4217-a66f-0e1f422636dd', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:4c:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9674107a-752c-42c3-a133-60c85d951af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:16Z', 'updated_at': '2021-11-18T18:21:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:05.615735 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a567e3e0-0697-4354-b8fe-ce3ce8d0b78b None None] Checking router: 9674107a-752c-42c3-a133-60c85d951af8 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:29:05.623621 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] For port 9796f4fb-9636-4217-a66f-0e1f422636dd, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=9796f4fb-9636-4217-a66f-0e1f422636dd,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:29:05.624189 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a567e3e0-0697-4354-b8fe-ce3ce8d0b78b None None] Routers {'9674107a-752c-42c3-a133-60c85d951af8'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:29:05.624293 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:05.624507 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-a567e3e0-0697-4354-b8fe-ce3ce8d0b78b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:28:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['9674107a-752c-42c3-a133-60c85d951af8'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:05.636403 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Calling delete_port for 9796f4fb-9636-4217-a66f-0e1f422636dd owned by network:router_gateway {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:29:05.709104 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-a567e3e0-0697-4354-b8fe-ce3ce8d0b78b None None] Set router 9674107a-752c-42c3-a133-60c85d951af8 gateway port host: None {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:29:05.761771 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-a567e3e0-0697-4354-b8fe-ce3ce8d0b78b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:29:05Z', 'revision_number': 6, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port_host': None}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:05.792341 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a567e3e0-0697-4354-b8fe-ce3ce8d0b78b None None] The sync data for ids ['9674107a-752c-42c3-a133-60c85d951af8'] in dv-cinder-787764-6-iscsi is: [{'id': '9674107a-752c-42c3-a133-60c85d951af8', 'name': 'tempest-AttachVolumeTestJSON-970776786-router', 'tenant_id': '1bab99f3344342578dc7b1c29b1ced7e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:29:05Z', 'revision_number': 6, 'project_id': '1bab99f3344342578dc7b1c29b1ced7e', 'gw_port_host': None}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:29:05.797419 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:05.822050 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Pushing event deleted for resources: {'Port': ['ID=9796f4fb-9636-4217-a66f-0e1f422636dd,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:05.882222 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-500475'] for router_gateway, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:05.967447 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-430336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-557'] for router, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:05.969558 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.012505 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-430347'] for router, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.012966 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9674107a-752c-42c3-a133-60c85d951af8 {{(pid=102689) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 18:29:06.017451 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] Publish callbacks [] for router, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.018588 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-b1fedbe5-7ba5-489e-9028-268ee6666e30 admin admin] 10.222.0.82 "DELETE /v2.0/routers/9674107a-752c-42c3-a133-60c85d951af8 HTTP/1.1" status: 204 len: 168 time: 0.7231147 Nov 18 18:29:06.021148 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44852) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:06.064752 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_v2 [None req-10ce6e32-af7b-4cca-b20a-1ab0518d024e admin admin] Deleting subnet 53535ce7-7c2a-450f-87e4-d092908ff080 {{(pid=102689) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:29:06.067797 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-10ce6e32-af7b-4cca-b20a-1ab0518d024e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.101106 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-10ce6e32-af7b-4cca-b20a-1ab0518d024e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12724830'] for subnet, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.182162 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-10ce6e32-af7b-4cca-b20a-1ab0518d024e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.238589 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-10ce6e32-af7b-4cca-b20a-1ab0518d024e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12723963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14479099'] for subnet, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.264506 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10ce6e32-af7b-4cca-b20a-1ab0518d024e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=53535ce7-7c2a-450f-87e4-d092908ff080,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:06.266401 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-10ce6e32-af7b-4cca-b20a-1ab0518d024e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.269668 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-10ce6e32-af7b-4cca-b20a-1ab0518d024e admin admin] 10.222.0.82 "DELETE /v2.0/subnets/53535ce7-7c2a-450f-87e4-d092908ff080 HTTP/1.1" status: 204 len: 168 time: 0.2475481 Nov 18 18:29:06.270630 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02ce2b89-3e19-49fd-946a-8607e2800072 None None] Network f2a08e65-1c6c-43fe-a019-78643e62bd9f requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:29:06.272062 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44854) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:06.349478 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.399218 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Deleting port 23788fbf-07af-4ed8-b5ac-3203649e3751 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:29:06.399542 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.476549 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] For port 23788fbf-07af-4ed8-b5ac-3203649e3751, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=23788fbf-07af-4ed8-b5ac-3203649e3751,segment=NetworkSegment(b2f6a54f-52ed-4860-8d6c-6ee082b77b95),segment_id=b2f6a54f-52ed-4860-8d6c-6ee082b77b95)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:29:06.477116 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.490842 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Calling delete_port for 23788fbf-07af-4ed8-b5ac-3203649e3751 owned by network:dhcp {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:29:06.524010 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-c4238d6d-8836-4d1d-81f2-9dd6287be701 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.617391 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c066b88-bfef-453e-8b6d-f759e0028520 None None] DHCP port deletion for f2a08e65-1c6c-43fe-a019-78643e62bd9f request from dv-cinder-787764-6-iscsi {{(pid=102690) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 18:29:06.623623 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 82ade1e6-a8c1-462a-97bb-16499ada8f89 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:29:06.644404 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.646342 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 82ade1e6-a8c1-462a-97bb-16499ada8f89 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:29:06.647978 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 82ade1e6-a8c1-462a-97bb-16499ada8f89 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:29:06.647978 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 9796f4fb-9636-4217-a66f-0e1f422636dd no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:29:06.673250 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] No DVR routers for this DVR port 23788fbf-07af-4ed8-b5ac-3203649e3751 on host dv-cinder-787764-6-iscsi {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:29:06.685262 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-2c066b88-bfef-453e-8b6d-f759e0028520 None None] The port '23788fbf-07af-4ed8-b5ac-3203649e3751' was deleted {{(pid=102690) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Nov 18 18:29:06.686952 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 9796f4fb-9636-4217-a66f-0e1f422636dd {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:29:06.687294 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 9796f4fb-9636-4217-a66f-0e1f422636dd not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:29:06.703044 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Pushing event deleted for resources: {'Port': ['ID=23788fbf-07af-4ed8-b5ac-3203649e3751,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:06.779645 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.809734 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc7ed94-a048-4714-8684-f72b87c2c573 req-4071152b-60e4-4c99-abc1-b9a8e3009af6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:29:06.811437 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1dc7ed94-a048-4714-8684-f72b87c2c573 req-4071152b-60e4-4c99-abc1-b9a8e3009af6 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 946 time: 0.1151237 Nov 18 18:29:06.813184 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f2a08e65-1c6c-43fe-a019-78643e62bd9f']}} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:06.834762 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95') {'for_net_delete': True} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:06.834762 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b2f6a54f-52ed-4860-8d6c-6ee082b77b95') {} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:06.847269 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12724807'] for segment, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.871736 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.884273 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Releasing vlan 1348 on physical network physnet1 to pool {{(pid=102689) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:29:06.884655 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12723877'] for segment, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: Traceback (most recent call last): Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: timer() Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: cb(*args, **kw) Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: return func(*args, **kwargs) Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: self._notify() Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: self.callback(batched_events) Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: event.method(event) Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: return f(self, *a, **k) Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._get(url).json() Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: return self.request(url, 'GET', **kwargs) Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:29:06.886278 dv-cinder-787764-6-iscsi neutron-server[102689]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:29:06.900491 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1dc7ed94-a048-4714-8684-f72b87c2c573 req-ca3a6172-8cc6-4f2e-9fb6-0e2645aa42a4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0794210 Nov 18 18:29:06.946314 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.952871 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:06.956115 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] 10.222.0.82 "DELETE /v2.0/networks/f2a08e65-1c6c-43fe-a019-78643e62bd9f HTTP/1.1" status: 204 len: 168 time: 0.6831129 Nov 18 18:29:06.966761 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-924e5d42-6841-42cc-822f-2e74649aaeea admin admin] Pushing event deleted for resources: {'Network': ['ID=f2a08e65-1c6c-43fe-a019-78643e62bd9f,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:07.065656 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44868) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:07.104677 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-92b042ca-0883-44bf-bb24-84c6f73be918 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1bab99f3344342578dc7b1c29b1ced7e&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0376964 Nov 18 18:29:07.107077 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44870) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:07.152078 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-67b10d1c-51c1-4872-9235-9b306122977e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:07.171967 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-67b10d1c-51c1-4872-9235-9b306122977e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:07.216758 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-67b10d1c-51c1-4872-9235-9b306122977e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:07.219329 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-67b10d1c-51c1-4872-9235-9b306122977e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:07.220530 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-67b10d1c-51c1-4872-9235-9b306122977e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/de2b0a73-6c00-439d-bfca-0151cdce9d19 HTTP/1.1" status: 204 len: 168 time: 0.1125855 Nov 18 18:29:07.228371 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67b10d1c-51c1-4872-9235-9b306122977e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de2b0a73-6c00-439d-bfca-0151cdce9d19,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:07.726040 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:08.049570 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b71a7d05-7c1b-4ab1-bb7d-640d89e32b92 req-0ba5850d-3a2b-4cdc-9a93-c71e37263747 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:29:08.051114 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b71a7d05-7c1b-4ab1-bb7d-640d89e32b92 req-0ba5850d-3a2b-4cdc-9a93-c71e37263747 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 946 time: 0.0791419 Nov 18 18:29:08.063548 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-ead466b8-d323-4a49-beb2-582bdbc53cd8 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:29:08.064997 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-ead466b8-d323-4a49-beb2-582bdbc53cd8 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.31 "GET /v2.0/ports?device_id=aadf26ad-ea3f-4ed0-937f-f8bfef48f099 HTTP/1.1" status: 200 len: 946 time: 0.0642428 Nov 18 18:29:08.160181 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b71a7d05-7c1b-4ab1-bb7d-640d89e32b92 req-b3b5fc82-739e-49ea-a4d0-eb6acdd107a4 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups?id=ba2984a9-3a0a-4797-8088-11df06eb8c5f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0941975 Nov 18 18:29:08.190561 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Deleting port 02e0aac7-3022-49e1-8484-d2e56545e298 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:29:08.190896 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:08.278025 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] For port 02e0aac7-3022-49e1-8484-d2e56545e298, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=02e0aac7-3022-49e1-8484-d2e56545e298,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:29:08.278386 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:08.444849 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 23788fbf-07af-4ed8-b5ac-3203649e3751 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:29:08.456981 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:08.457340 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:08.457652 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Floating IP edb62647-cddf-4ee8-9e73-2e273a7eb213 disassociated. External IP: 172.27.1.78, port: 02e0aac7-3022-49e1-8484-d2e56545e298. Nov 18 18:29:08.457995 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Calling delete_port for 02e0aac7-3022-49e1-8484-d2e56545e298 owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:29:08.467164 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 23788fbf-07af-4ed8-b5ac-3203649e3751 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:29:08.467961 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 23788fbf-07af-4ed8-b5ac-3203649e3751 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:29:08.592278 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:08.618960 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event deleted for resources: {'Port': ['ID=02e0aac7-3022-49e1-8484-d2e56545e298,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:08.736475 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Router 5f928fdc-791e-4821-b088-039c140695e9 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:29:08.851445 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:29:08.862406 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dcfdefe-b6c4-4b99-98b4-220cbb098e09 None None] Sync routers for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:29:08.871955 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dcfdefe-b6c4-4b99-98b4-220cbb098e09 None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:29:08.872543 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-1dcfdefe-b6c4-4b99-98b4-220cbb098e09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:29:07Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:08.890322 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] No DVR routers for this DVR port 02e0aac7-3022-49e1-8484-d2e56545e298 on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:29:08.892828 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:08.896182 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9ff6a605-910a-405a-9daf-2322a76c0dbe req-21a66da2-2e60-4ddb-8e10-f08e5126a1db tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.31 "DELETE /v2.0/ports/02e0aac7-3022-49e1-8484-d2e56545e298 HTTP/1.1" status: 204 len: 173 time: 0.8236263 Nov 18 18:29:08.896616 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'name': 'network-vif-deleted', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:29:08.899194 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-142c3c0a-3817-4493-8b19-f37c773bd3a9" -d '{"events": [{"server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "name": "network-vif-deleted", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:29:08.946295 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:29:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd3cbabe-5e40-40bf-b59d-b46266262672 x-openstack-request-id: req-cd3cbabe-5e40-40bf-b59d-b46266262672 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:29:08.946642 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "aadf26ad-ea3f-4ed0-937f-f8bfef48f099", "name": "network-vif-deleted", "tag": "02e0aac7-3022-49e1-8484-d2e56545e298", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:29:08.946964 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-cd3cbabe-5e40-40bf-b59d-b46266262672 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:29:08.947421 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aadf26ad-ea3f-4ed0-937f-f8bfef48f099', 'name': 'network-vif-deleted', 'tag': '02e0aac7-3022-49e1-8484-d2e56545e298', 'status': 'completed', 'code': 200} Nov 18 18:29:08.982872 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-1dcfdefe-b6c4-4b99-98b4-220cbb098e09 None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:29:09.077834 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:09.211208 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-1dcfdefe-b6c4-4b99-98b4-220cbb098e09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:24Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:09.237759 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dcfdefe-b6c4-4b99-98b4-220cbb098e09 None None] Checking router: 5f928fdc-791e-4821-b088-039c140695e9 for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:29:09.247277 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dcfdefe-b6c4-4b99-98b4-220cbb098e09 None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:29:09.247898 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-1dcfdefe-b6c4-4b99-98b4-220cbb098e09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:29:07Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:09.248478 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 44922) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:09.302716 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-991227b0-454e-4f87-a809-fa2d76b1eed3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:09.325756 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-991227b0-454e-4f87-a809-fa2d76b1eed3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:09.351894 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-1dcfdefe-b6c4-4b99-98b4-220cbb098e09 None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:29:09.373529 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-991227b0-454e-4f87-a809-fa2d76b1eed3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:09.376252 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-991227b0-454e-4f87-a809-fa2d76b1eed3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:09.377442 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-991227b0-454e-4f87-a809-fa2d76b1eed3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "DELETE /v2.0/security-groups/ba2984a9-3a0a-4797-8088-11df06eb8c5f HTTP/1.1" status: 204 len: 168 time: 0.1276798 Nov 18 18:29:09.380300 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44924) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:09.386396 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-991227b0-454e-4f87-a809-fa2d76b1eed3 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba2984a9-3a0a-4797-8088-11df06eb8c5f,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:09.403313 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.api.v2.resource [None req-0aaffea1-ab4c-48a2-a23f-9271b1a0ae19 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] show failed (client error): The resource could not be found. Nov 18 18:29:09.404925 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-0aaffea1-ab4c-48a2-a23f-9271b1a0ae19 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "GET /v2.0/security-groups/ba2984a9-3a0a-4797-8088-11df06eb8c5f HTTP/1.1" status: 404 len: 347 time: 0.0230374 Nov 18 18:29:09.407870 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44926) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:09.528806 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-ba80c0d7-8f61-4a22-b512-531c04a84654 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Deleting port 0d549f55-e60c-4f50-a96c-c186bae633c9 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:29:09.529624 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ba80c0d7-8f61-4a22-b512-531c04a84654 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:09.552913 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-1dcfdefe-b6c4-4b99-98b4-220cbb098e09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:24Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:09.605320 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ba80c0d7-8f61-4a22-b512-531c04a84654 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:09.605645 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ba80c0d7-8f61-4a22-b512-531c04a84654 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:09.623194 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-ba80c0d7-8f61-4a22-b512-531c04a84654 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Calling delete_port for 0d549f55-e60c-4f50-a96c-c186bae633c9 owned by network:floatingip {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:29:09.662963 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dcfdefe-b6c4-4b99-98b4-220cbb098e09 None None] The sync data for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi is: [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:21:16Z', 'revision_number': 4, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '7d6934a0-5c28-4a10-a5e5-fd96332c82b4', 'name': '', 'network_id': 'd845755f-6a59-4935-8123-1a70c6e45968', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'mac_address': 'fa:16:3e:fe:0e:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:14Z', 'updated_at': '2021-11-18T18:21:24Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'subnets': [{'id': '690618f7-2d23-41bc-866f-0d343d1149d2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:29:09.762430 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ba80c0d7-8f61-4a22-b512-531c04a84654 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:09.788875 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba80c0d7-8f61-4a22-b512-531c04a84654 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Pushing event deleted for resources: {'Port': ['ID=0d549f55-e60c-4f50-a96c-c186bae633c9,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:09.857786 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ba80c0d7-8f61-4a22-b512-531c04a84654 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks [] for floatingip, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:09.860532 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ba80c0d7-8f61-4a22-b512-531c04a84654 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:09.861867 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-ba80c0d7-8f61-4a22-b512-531c04a84654 tempest-AttachVolumeShelveTestJSON-456476909 tempest-AttachVolumeShelveTestJSON-456476909-project] 10.222.0.82 "DELETE /v2.0/floatingips/edb62647-cddf-4ee8-9e73-2e273a7eb213 HTTP/1.1" status: 204 len: 168 time: 0.4529951 Nov 18 18:29:09.896345 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-574e8037-f3c8-426a-a226-6204dc02d737 None None] New status for floating IP edb62647-cddf-4ee8-9e73-2e273a7eb213: DOWN {{(pid=102690) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:29:10.191363 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:13.054353 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 02e0aac7-3022-49e1-8484-d2e56545e298 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:29:13.073655 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: 02e0aac7-3022-49e1-8484-d2e56545e298 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:29:13.074001 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 02e0aac7-3022-49e1-8484-d2e56545e298 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:29:14.376777 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44976) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:15.095438 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-500d56ce-f5db-436a-9c14-6296dbbf27b7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-499121'] for router_interface, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:15.333723 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-500d56ce-f5db-436a-9c14-6296dbbf27b7 admin admin] Deleting port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:29:15.334054 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-500d56ce-f5db-436a-9c14-6296dbbf27b7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:15.412949 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-500d56ce-f5db-436a-9c14-6296dbbf27b7 admin admin] For port 7d6934a0-5c28-4a10-a5e5-fd96332c82b4, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=7d6934a0-5c28-4a10-a5e5-fd96332c82b4,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:29:15.413622 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-500d56ce-f5db-436a-9c14-6296dbbf27b7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:15.425832 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-500d56ce-f5db-436a-9c14-6296dbbf27b7 admin admin] Calling delete_port for 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 owned by network:router_interface {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:29:15.600124 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-500d56ce-f5db-436a-9c14-6296dbbf27b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:15.626528 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-500d56ce-f5db-436a-9c14-6296dbbf27b7 admin admin] Pushing event deleted for resources: {'Port': ['ID=7d6934a0-5c28-4a10-a5e5-fd96332c82b4,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:15.784976 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-500d56ce-f5db-436a-9c14-6296dbbf27b7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1772491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-498973'] for router_interface, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:15.992952 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-500d56ce-f5db-436a-9c14-6296dbbf27b7 admin admin] Router 5f928fdc-791e-4821-b088-039c140695e9 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:29:16.097793 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-500d56ce-f5db-436a-9c14-6296dbbf27b7 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:29:16.103889 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-500d56ce-f5db-436a-9c14-6296dbbf27b7 admin admin] 10.222.0.82 "PUT /v2.0/routers/5f928fdc-791e-4821-b088-039c140695e9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7257583 Nov 18 18:29:16.105569 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44986) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:16.108592 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff2afef-88f4-4210-a7b4-d44e3c8289fb None None] Sync routers for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:29:16.118052 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff2afef-88f4-4210-a7b4-d44e3c8289fb None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:29:16.118640 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-6ff2afef-88f4-4210-a7b4-d44e3c8289fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:29:07Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:16.207209 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Publish callbacks [] for router, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:16.221437 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-6ff2afef-88f4-4210-a7b4-d44e3c8289fb None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:29:16.307123 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:16.358154 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Deleting port 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:29:16.358484 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:16.397100 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-6ff2afef-88f4-4210-a7b4-d44e3c8289fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146'}], 'enable_snat': True}, 'gw_port_id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:29:15Z', 'revision_number': 5, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port': {'id': '5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2b:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f928fdc-791e-4821-b088-039c140695e9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 43, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.146', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:21:09Z', 'updated_at': '2021-11-18T18:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:16.424610 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff2afef-88f4-4210-a7b4-d44e3c8289fb None None] Checking router: 5f928fdc-791e-4821-b088-039c140695e9 for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:29:16.432841 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff2afef-88f4-4210-a7b4-d44e3c8289fb None None] Routers {'5f928fdc-791e-4821-b088-039c140695e9'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:29:16.433438 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-6ff2afef-88f4-4210-a7b4-d44e3c8289fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:29:07Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['5f928fdc-791e-4821-b088-039c140695e9'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:16.443529 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] For port 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:29:16.444104 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:16.458108 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Calling delete_port for 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 owned by network:router_gateway {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:29:16.517477 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-6ff2afef-88f4-4210-a7b4-d44e3c8289fb None None] Set router 5f928fdc-791e-4821-b088-039c140695e9 gateway port host: None {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:29:16.570561 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-6ff2afef-88f4-4210-a7b4-d44e3c8289fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:29:16Z', 'revision_number': 6, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port_host': None}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:16.601484 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff2afef-88f4-4210-a7b4-d44e3c8289fb None None] The sync data for ids ['5f928fdc-791e-4821-b088-039c140695e9'] in dv-cinder-787764-6-iscsi is: [{'id': '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'tempest-AttachVolumeShelveTestJSON-1862085366-router', 'tenant_id': '6a79674a70ee4ad7acedc7d4896b413e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:21:08Z', 'updated_at': '2021-11-18T18:29:16Z', 'revision_number': 6, 'project_id': '6a79674a70ee4ad7acedc7d4896b413e', 'gw_port_host': None}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:29:16.623512 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:16.648620 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Pushing event deleted for resources: {'Port': ['ID=5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:16.710860 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-500475'] for router_gateway, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:16.796890 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-430336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-557'] for router, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:16.798977 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:16.845762 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-430347'] for router, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:16.846294 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5f928fdc-791e-4821-b088-039c140695e9 {{(pid=102689) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 18:29:16.851066 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] Publish callbacks [] for router, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:16.852225 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-c53982fd-1c16-4c87-bd74-6617d0319bd5 admin admin] 10.222.0.82 "DELETE /v2.0/routers/5f928fdc-791e-4821-b088-039c140695e9 HTTP/1.1" status: 204 len: 168 time: 0.7457261 Nov 18 18:29:16.854672 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44990) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:16.898179 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_v2 [None req-fa5a23f0-b02e-4555-9b18-f6de1144dc35 admin admin] Deleting subnet 690618f7-2d23-41bc-866f-0d343d1149d2 {{(pid=102689) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:29:16.901182 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fa5a23f0-b02e-4555-9b18-f6de1144dc35 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:16.933282 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fa5a23f0-b02e-4555-9b18-f6de1144dc35 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12724830'] for subnet, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.017003 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fa5a23f0-b02e-4555-9b18-f6de1144dc35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.067042 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fa5a23f0-b02e-4555-9b18-f6de1144dc35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12723963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14479099'] for subnet, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.093618 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa5a23f0-b02e-4555-9b18-f6de1144dc35 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=690618f7-2d23-41bc-866f-0d343d1149d2,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:17.095574 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-fa5a23f0-b02e-4555-9b18-f6de1144dc35 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.101458 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-fa5a23f0-b02e-4555-9b18-f6de1144dc35 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/690618f7-2d23-41bc-866f-0d343d1149d2 HTTP/1.1" status: 204 len: 168 time: 0.2432039 Nov 18 18:29:17.101923 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d75a53b0-6a29-44b5-af06-df65acb21e18 None None] Network d845755f-6a59-4935-8123-1a70c6e45968 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:29:17.102461 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44992) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:17.170082 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.225248 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Deleting port 97c831a7-d8cf-4603-8659-4d1b9fd72141 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:29:17.225589 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.288042 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] For port 97c831a7-d8cf-4603-8659-4d1b9fd72141, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=97c831a7-d8cf-4603-8659-4d1b9fd72141,segment=NetworkSegment(8eec1f1e-2e54-42fa-aa94-4d0a1a513db5),segment_id=8eec1f1e-2e54-42fa-aa94-4d0a1a513db5)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:29:17.288357 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.300744 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Calling delete_port for 97c831a7-d8cf-4603-8659-4d1b9fd72141 owned by network:dhcp {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:29:17.359195 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85f6cb40-b2fa-44a9-8009-ad619112e332 None None] DHCP port deletion for d845755f-6a59-4935-8123-1a70c6e45968 request from dv-cinder-787764-6-iscsi {{(pid=102690) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 18:29:17.384591 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.406455 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-85f6cb40-b2fa-44a9-8009-ad619112e332 None None] Deleting port 97c831a7-d8cf-4603-8659-4d1b9fd72141 {{(pid=102690) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:29:17.406829 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-85f6cb40-b2fa-44a9-8009-ad619112e332 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.412346 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Pushing event deleted for resources: {'Port': ['ID=97c831a7-d8cf-4603-8659-4d1b9fd72141,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:17.414169 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] No DVR routers for this DVR port 97c831a7-d8cf-4603-8659-4d1b9fd72141 on host dv-cinder-787764-6-iscsi {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:29:17.469877 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-85f6cb40-b2fa-44a9-8009-ad619112e332 None None] For port 97c831a7-d8cf-4603-8659-4d1b9fd72141, host dv-cinder-787764-6-iscsi, got binding levels [] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:29:17.470271 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-85f6cb40-b2fa-44a9-8009-ad619112e332 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.483787 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-85f6cb40-b2fa-44a9-8009-ad619112e332 None None] Calling delete_port for 97c831a7-d8cf-4603-8659-4d1b9fd72141 owned by network:dhcp {{(pid=102690) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:29:17.486513 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.ipam_backend_mixin [None req-85f6cb40-b2fa-44a9-8009-ad619112e332 None None] Port 97c831a7-d8cf-4603-8659-4d1b9fd72141 was not found and therefore no delete operation was performed {{(pid=102690) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 18 18:29:17.487814 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-85f6cb40-b2fa-44a9-8009-ad619112e332 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596'] for port, after_delete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.489471 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.509205 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d845755f-6a59-4935-8123-1a70c6e45968']}} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:17.518983 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5') {'for_net_delete': True} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:17.519278 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8eec1f1e-2e54-42fa-aa94-4d0a1a513db5') {} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:17.521639 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85f6cb40-b2fa-44a9-8009-ad619112e332 None None] Pushing event deleted for resources: {'Port': ['ID=97c831a7-d8cf-4603-8659-4d1b9fd72141,revision_number=None']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:17.527748 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85f6cb40-b2fa-44a9-8009-ad619112e332 None None] No DVR routers for this DVR port 97c831a7-d8cf-4603-8659-4d1b9fd72141 on host dv-cinder-787764-6-iscsi {{(pid=102690) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:29:17.529836 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12724807'] for segment, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.551087 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.557771 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Releasing vlan 1342 on physical network physnet1 to pool {{(pid=102689) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:29:17.558224 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12723877'] for segment, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: Traceback (most recent call last): Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: timer() Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: cb(*args, **kw) Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: return func(*args, **kwargs) Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: self._notify() Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: self.callback(batched_events) Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: event.method(event) Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: return f(self, *a, **k) Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._get(url).json() Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: return self.request(url, 'GET', **kwargs) Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:29:17.560198 dv-cinder-787764-6-iscsi neutron-server[102689]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:29:17.618226 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.622597 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.626305 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] 10.222.0.82 "DELETE /v2.0/networks/d845755f-6a59-4935-8123-1a70c6e45968 HTTP/1.1" status: 204 len: 168 time: 0.5237598 Nov 18 18:29:17.642143 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0a39a69-df8f-481d-a253-52776450f58b admin admin] Pushing event deleted for resources: {'Network': ['ID=d845755f-6a59-4935-8123-1a70c6e45968,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:17.741820 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 44998) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:17.783378 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-753661f6-7a3c-4523-b002-8f485fa7d394 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6a79674a70ee4ad7acedc7d4896b413e&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0403931 Nov 18 18:29:17.785865 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45000) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:17.834281 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a938e336-c145-40b8-8cfc-3daade7174d6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.855060 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a938e336-c145-40b8-8cfc-3daade7174d6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.899898 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a938e336-c145-40b8-8cfc-3daade7174d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.902416 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a938e336-c145-40b8-8cfc-3daade7174d6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:17.903549 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-a938e336-c145-40b8-8cfc-3daade7174d6 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/880a9af6-6df3-43c8-a35e-68211a1c5c1b HTTP/1.1" status: 204 len: 168 time: 0.1168063 Nov 18 18:29:17.911455 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a938e336-c145-40b8-8cfc-3daade7174d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=880a9af6-6df3-43c8-a35e-68211a1c5c1b,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:18.447262 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 97c831a7-d8cf-4603-8659-4d1b9fd72141 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:29:18.472444 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 97c831a7-d8cf-4603-8659-4d1b9fd72141 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:29:18.472910 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 97c831a7-d8cf-4603-8659-4d1b9fd72141 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:29:18.473324 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:29:18.493430 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:29:18.493774 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 5e6c4f8f-bb16-4469-ab04-15b7e0d45bf2 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:29:18.494192 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:29:18.512938 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:29:18.513283 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 7d6934a0-5c28-4a10-a5e5-fd96332c82b4 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:29:21.173330 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:23.109939 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b5343c12-7441-46b1-98ab-c5edb88ae10c req-4c1f69c2-9f2d-4325-b191-5fb9940ce487 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0396688 Nov 18 18:29:23.193363 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5343c12-7441-46b1-98ab-c5edb88ae10c req-ff9c8c02-d7ab-4b7d-adb6-632fc4eb6f38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:29:23.194853 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b5343c12-7441-46b1-98ab-c5edb88ae10c req-ff9c8c02-d7ab-4b7d-adb6-632fc4eb6f38 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 1099 time: 0.0398133 Nov 18 18:29:23.303035 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5343c12-7441-46b1-98ab-c5edb88ae10c req-34246b9f-65b0-4354-b22f-b0a5a425ae05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:29:23.304524 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b5343c12-7441-46b1-98ab-c5edb88ae10c req-34246b9f-65b0-4354-b22f-b0a5a425ae05 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 913 time: 0.0908432 Nov 18 18:29:23.367448 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b5343c12-7441-46b1-98ab-c5edb88ae10c req-a76c14a8-abde-4c3c-96f3-f211b12b8b79 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ccea3eb1-d1c4-4326-b70b-95e79feb632e HTTP/1.1" status: 200 len: 1002 time: 0.0551329 Nov 18 18:29:23.419294 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5343c12-7441-46b1-98ab-c5edb88ae10c req-8f5b80a8-80ac-4ff1-be88-7dc382f0bb70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:29:23.420803 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b5343c12-7441-46b1-98ab-c5edb88ae10c req-8f5b80a8-80ac-4ff1-be88-7dc382f0bb70 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0461223 Nov 18 18:29:23.468707 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5343c12-7441-46b1-98ab-c5edb88ae10c req-4e903ff5-4bd7-40aa-98a7-f7e357c93c2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:29:23.470225 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b5343c12-7441-46b1-98ab-c5edb88ae10c req-4e903ff5-4bd7-40aa-98a7-f7e357c93c2a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0422828 Nov 18 18:29:23.477749 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:29:23.564726 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b5343c12-7441-46b1-98ab-c5edb88ae10c req-0c9530b1-567b-42cd-9567-02b302082fd8 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865860 Nov 18 18:29:23.672211 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45094) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:23.781346 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8323fb86-6e84-46ae-9dd4-683cc34ab8f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:23.857746 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8323fb86-6e84-46ae-9dd4-683cc34ab8f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:23.861225 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-8323fb86-6e84-46ae-9dd4-683cc34ab8f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:23.894811 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b5343c12-7441-46b1-98ab-c5edb88ae10c req-9cb886a0-086d-4f56-80b8-05d4908de2c3 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3231854 Nov 18 18:29:23.900248 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-8323fb86-6e84-46ae-9dd4-683cc34ab8f7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=85fff3e0c1d24c9fb2ace08cd737f9b3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2268462 Nov 18 18:29:23.901180 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8323fb86-6e84-46ae-9dd4-683cc34ab8f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5fcb73b0-fc8d-4199-9b66-3fc9794d0bb0,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:23.902787 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45098) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:23.951011 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-8efa706e-7c2e-446f-b3f0-5b4b71ddce8d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:23.970890 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-8efa706e-7c2e-446f-b3f0-5b4b71ddce8d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:24.018395 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-8efa706e-7c2e-446f-b3f0-5b4b71ddce8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:24.021015 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-8efa706e-7c2e-446f-b3f0-5b4b71ddce8d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:24.022137 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-8efa706e-7c2e-446f-b3f0-5b4b71ddce8d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5fcb73b0-fc8d-4199-9b66-3fc9794d0bb0 HTTP/1.1" status: 204 len: 168 time: 0.1180313 Nov 18 18:29:24.030191 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8efa706e-7c2e-446f-b3f0-5b4b71ddce8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5fcb73b0-fc8d-4199-9b66-3fc9794d0bb0,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:25.384923 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45156) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:25.508953 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a88a4bed-d715-44e6-b788-44ef44f86008 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:25.585494 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a88a4bed-d715-44e6-b788-44ef44f86008 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:25.589109 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a88a4bed-d715-44e6-b788-44ef44f86008 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:25.627121 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-a88a4bed-d715-44e6-b788-44ef44f86008 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f511c2ed412e449ba362b3ee1a67ca07&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2410762 Nov 18 18:29:25.628286 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a88a4bed-d715-44e6-b788-44ef44f86008 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d0916c2-43a4-4c0d-8c90-ff3ff9a60c23,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:25.629811 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45162) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:25.679261 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-332ed5de-8e7e-4f82-af86-815e1b72ec4e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:25.699571 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-332ed5de-8e7e-4f82-af86-815e1b72ec4e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:25.745035 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-332ed5de-8e7e-4f82-af86-815e1b72ec4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:25.747631 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-332ed5de-8e7e-4f82-af86-815e1b72ec4e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:25.748816 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-332ed5de-8e7e-4f82-af86-815e1b72ec4e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1d0916c2-43a4-4c0d-8c90-ff3ff9a60c23 HTTP/1.1" status: 204 len: 168 time: 0.1179469 Nov 18 18:29:25.756467 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-332ed5de-8e7e-4f82-af86-815e1b72ec4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d0916c2-43a4-4c0d-8c90-ff3ff9a60c23,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:26.003149 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45168) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:26.016652 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9d1b9cac-a9db-452d-aca2-ff9009f3e9f2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:26.087351 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9d1b9cac-a9db-452d-aca2-ff9009f3e9f2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:26.090766 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9d1b9cac-a9db-452d-aca2-ff9009f3e9f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:26.127305 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-9d1b9cac-a9db-452d-aca2-ff9009f3e9f2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b2a9e5442d50435a966c58f2ca3e11b4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1230729 Nov 18 18:29:26.128377 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d1b9cac-a9db-452d-aca2-ff9009f3e9f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c678889-cf01-4665-b0eb-99ed890ed23e,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:26.130016 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45170) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:26.177251 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b7ab9f91-14d4-42f3-9dd3-6f34620312dc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:26.198150 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b7ab9f91-14d4-42f3-9dd3-6f34620312dc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:26.244136 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b7ab9f91-14d4-42f3-9dd3-6f34620312dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:26.246696 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b7ab9f91-14d4-42f3-9dd3-6f34620312dc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:26.247865 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-b7ab9f91-14d4-42f3-9dd3-6f34620312dc admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5c678889-cf01-4665-b0eb-99ed890ed23e HTTP/1.1" status: 204 len: 168 time: 0.1168084 Nov 18 18:29:26.255249 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7ab9f91-14d4-42f3-9dd3-6f34620312dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c678889-cf01-4665-b0eb-99ed890ed23e,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:27.976696 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45236) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:28.078656 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-09e2ddbc-d050-4776-baa3-a719805f6e77 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.151878 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-09e2ddbc-d050-4776-baa3-a719805f6e77 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.156780 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-09e2ddbc-d050-4776-baa3-a719805f6e77 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.194856 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-09e2ddbc-d050-4776-baa3-a719805f6e77 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0135d0f7f7744504bc39a91191bb8a1d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2171040 Nov 18 18:29:28.195703 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09e2ddbc-d050-4776-baa3-a719805f6e77 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5fbd0b37-d1b2-4293-bbde-910f679cefce,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:28.197629 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45240) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:28.248342 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b3b23b8e-413e-4e98-b468-ac8afbfb2d0e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.269041 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b3b23b8e-413e-4e98-b468-ac8afbfb2d0e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.313346 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b3b23b8e-413e-4e98-b468-ac8afbfb2d0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.315760 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-b3b23b8e-413e-4e98-b468-ac8afbfb2d0e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.316918 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-b3b23b8e-413e-4e98-b468-ac8afbfb2d0e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5fbd0b37-d1b2-4293-bbde-910f679cefce HTTP/1.1" status: 204 len: 168 time: 0.1182680 Nov 18 18:29:28.324200 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3b23b8e-413e-4e98-b468-ac8afbfb2d0e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5fbd0b37-d1b2-4293-bbde-910f679cefce,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:28.572318 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45248) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:28.585722 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c4f6504b-7963-4a06-92a9-2f75f13dbb6e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.657956 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c4f6504b-7963-4a06-92a9-2f75f13dbb6e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.661357 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c4f6504b-7963-4a06-92a9-2f75f13dbb6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.697336 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-c4f6504b-7963-4a06-92a9-2f75f13dbb6e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d845762ad3764fad8e50c0e5692caffb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1239762 Nov 18 18:29:28.699255 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f6504b-7963-4a06-92a9-2f75f13dbb6e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=752951ed-620e-4683-9df0-78cce176c5fe,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:28.700057 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45250) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:28.753705 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-67607530-c77a-4310-9d7b-9789d2882344 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.776135 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-67607530-c77a-4310-9d7b-9789d2882344 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.821642 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-67607530-c77a-4310-9d7b-9789d2882344 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.824171 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-67607530-c77a-4310-9d7b-9789d2882344 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:28.825338 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-67607530-c77a-4310-9d7b-9789d2882344 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/752951ed-620e-4683-9df0-78cce176c5fe HTTP/1.1" status: 204 len: 168 time: 0.1236441 Nov 18 18:29:28.833475 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67607530-c77a-4310-9d7b-9789d2882344 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=752951ed-620e-4683-9df0-78cce176c5fe,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:33.074435 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45358) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:33.175761 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5ea45dbe-8d3d-4da7-b3ef-32f297a51be3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.247109 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5ea45dbe-8d3d-4da7-b3ef-32f297a51be3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.251372 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5ea45dbe-8d3d-4da7-b3ef-32f297a51be3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.292510 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-5ea45dbe-8d3d-4da7-b3ef-32f297a51be3 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f6cb1b2bf71a415fbce30761711ae7f5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2170215 Nov 18 18:29:33.293634 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ea45dbe-8d3d-4da7-b3ef-32f297a51be3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=faeedecd-4515-4e04-8b79-30341d3bd2c5,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:33.295180 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45362) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:33.341730 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a847bab2-2e53-4e45-bdea-9e1c4411f1d2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.363824 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a847bab2-2e53-4e45-bdea-9e1c4411f1d2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.407390 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a847bab2-2e53-4e45-bdea-9e1c4411f1d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.409934 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-a847bab2-2e53-4e45-bdea-9e1c4411f1d2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.411042 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-a847bab2-2e53-4e45-bdea-9e1c4411f1d2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/faeedecd-4515-4e04-8b79-30341d3bd2c5 HTTP/1.1" status: 204 len: 168 time: 0.1147439 Nov 18 18:29:33.418387 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a847bab2-2e53-4e45-bdea-9e1c4411f1d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=faeedecd-4515-4e04-8b79-30341d3bd2c5,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:33.657877 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45368) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:33.670513 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f128bfab-85b8-46a4-a622-9ccef4e2680b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.741559 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f128bfab-85b8-46a4-a622-9ccef4e2680b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.745009 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f128bfab-85b8-46a4-a622-9ccef4e2680b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.782824 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-f128bfab-85b8-46a4-a622-9ccef4e2680b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=21a2cca2e5e64eebaf85d41731cb88d0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1238842 Nov 18 18:29:33.783689 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f128bfab-85b8-46a4-a622-9ccef4e2680b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a433b4f9-7b48-42f8-a691-185abe4af4f3,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:33.785510 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45370) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:33.832345 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6ff2b11a-f9d7-4de3-87bf-beb4a3d6de45 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.853108 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6ff2b11a-f9d7-4de3-87bf-beb4a3d6de45 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.897814 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6ff2b11a-f9d7-4de3-87bf-beb4a3d6de45 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.900418 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-6ff2b11a-f9d7-4de3-87bf-beb4a3d6de45 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:33.901549 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-6ff2b11a-f9d7-4de3-87bf-beb4a3d6de45 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a433b4f9-7b48-42f8-a691-185abe4af4f3 HTTP/1.1" status: 204 len: 168 time: 0.1150932 Nov 18 18:29:33.910289 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ff2b11a-f9d7-4de3-87bf-beb4a3d6de45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a433b4f9-7b48-42f8-a691-185abe4af4f3,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:33.997438 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-8c4a9d48-5afb-4b00-8fc1-8bcea1756a75 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:35.863951 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45452) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:35.964338 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fd5a1c95-8d05-4e87-9376-9b4a726c0dc5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.036368 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fd5a1c95-8d05-4e87-9376-9b4a726c0dc5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.039857 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fd5a1c95-8d05-4e87-9376-9b4a726c0dc5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.077071 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-fd5a1c95-8d05-4e87-9376-9b4a726c0dc5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=0bf6a51584bf419e86af63af9d8ad4dc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2120757 Nov 18 18:29:36.078184 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd5a1c95-8d05-4e87-9376-9b4a726c0dc5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b07b08ba-ceeb-4b6e-bfee-961a288899f1,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:36.079780 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45456) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:36.126815 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c7e9d76d-7794-4578-b8e0-85fc38ff993b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.146589 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c7e9d76d-7794-4578-b8e0-85fc38ff993b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.194256 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c7e9d76d-7794-4578-b8e0-85fc38ff993b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.197181 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c7e9d76d-7794-4578-b8e0-85fc38ff993b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.198357 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-c7e9d76d-7794-4578-b8e0-85fc38ff993b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b07b08ba-ceeb-4b6e-bfee-961a288899f1 HTTP/1.1" status: 204 len: 168 time: 0.1175611 Nov 18 18:29:36.206088 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7e9d76d-7794-4578-b8e0-85fc38ff993b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b07b08ba-ceeb-4b6e-bfee-961a288899f1,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:36.437385 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-d7d0f758-b41d-4d6a-9084-185420e510a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.484742 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45480) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:36.497989 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4ec3a9d2-95c1-4d55-a558-37db10c1e754 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.572948 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4ec3a9d2-95c1-4d55-a558-37db10c1e754 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.578203 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4ec3a9d2-95c1-4d55-a558-37db10c1e754 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.618324 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-4ec3a9d2-95c1-4d55-a558-37db10c1e754 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7b76caa550c14b538af6c52b13d05a54&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1320152 Nov 18 18:29:36.620490 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ec3a9d2-95c1-4d55-a558-37db10c1e754 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3cae8952-7ad8-4a76-9eeb-a128f5f4ab0a,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:36.620881 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45494) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:36.671075 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2c3edfb5-860b-46e3-8b1b-8633e6cd8365 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.691168 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2c3edfb5-860b-46e3-8b1b-8633e6cd8365 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.739470 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2c3edfb5-860b-46e3-8b1b-8633e6cd8365 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.742645 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-2c3edfb5-860b-46e3-8b1b-8633e6cd8365 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:36.743792 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-2c3edfb5-860b-46e3-8b1b-8633e6cd8365 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3cae8952-7ad8-4a76-9eeb-a128f5f4ab0a HTTP/1.1" status: 204 len: 168 time: 0.1218750 Nov 18 18:29:36.752380 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c3edfb5-860b-46e3-8b1b-8633e6cd8365 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3cae8952-7ad8-4a76-9eeb-a128f5f4ab0a,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:37.389897 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45516) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:37.485471 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-722228492-network', 'tenant_id': '4b1c6330fc894b5a8ce788cffb0ab0be'}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:29:37.505378 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Made reservation on behalf of 4b1c6330fc894b5a8ce788cffb0ab0be for: {'network': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:29:37.507517 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:37.515692 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:37.586484 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:37.589764 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:37.610718 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1347} {{(pid=102688) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:29:37.624912 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f0881c87-670c-4272-b3fc-f187c9303065,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:37.627687 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:37.628051 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.db.segments_db [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Added segment 8b6d9f22-bf33-4dbc-8d3e-bd009420cb9b of type vlan for network d8199cdc-db2a-43b0-8044-6519d2b2029c Nov 18 18:29:37.667061 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:37.694029 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:37.695027 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:29:37.695616 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:37.727419 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3364265 Nov 18 18:29:37.730334 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45526) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:37.736990 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-32d83f30-b682-49d5-aaca-d9a652f94beb admin admin] Request body: {'subnet': {'network_id': 'd8199cdc-db2a-43b0-8044-6519d2b2029c', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-722228492-subnet', 'tenant_id': '4b1c6330fc894b5a8ce788cffb0ab0be', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:29:37.745084 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:37.764188 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96476ae4-f1d3-4f43-a9d6-70528c0e0a1c admin admin] Pushing event updated for resources: {'Network': ['ID=d8199cdc-db2a-43b0-8044-6519d2b2029c,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:37.764890 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-32d83f30-b682-49d5-aaca-d9a652f94beb admin admin] Made reservation on behalf of 4b1c6330fc894b5a8ce788cffb0ab0be for: {'subnet': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:29:37.768302 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-32d83f30-b682-49d5-aaca-d9a652f94beb admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14479070'] for subnet, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:37.775018 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network d8199cdc-db2a-43b0-8044-6519d2b2029c details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:29:37.931388 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-32d83f30-b682-49d5-aaca-d9a652f94beb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-12723770', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14479088'] for subnet, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:37.986622 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32d83f30-b682-49d5-aaca-d9a652f94beb admin admin] Pushing event updated for resources: {'Subnet': ['ID=a2c87dea-60ea-4426-afab-c3f705d00eef,revision_number=0']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:37.995133 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32d83f30-b682-49d5-aaca-d9a652f94beb admin admin] Checking segment: {'id': '8b6d9f22-bf33-4dbc-8d3e-bd009420cb9b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1347, 'network_id': 'd8199cdc-db2a-43b0-8044-6519d2b2029c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:29:37.995486 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32d83f30-b682-49d5-aaca-d9a652f94beb admin admin] Network hostable DHCP agents. Network: d8199cdc-db2a-43b0-8044-6519d2b2029c, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102689) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:29:38.011287 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32d83f30-b682-49d5-aaca-d9a652f94beb admin admin] Network d8199cdc-db2a-43b0-8044-6519d2b2029c is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102689) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:29:38.019978 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-32d83f30-b682-49d5-aaca-d9a652f94beb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, d8199cdc-db2a-43b0-8044-6519d2b2029c) {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:29:38.023892 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32d83f30-b682-49d5-aaca-d9a652f94beb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:29:38.024518 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-32d83f30-b682-49d5-aaca-d9a652f94beb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:38.028963 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3b0bb67-5675-46ab-a3f6-4262de0c79c9 None None] Network d8199cdc-db2a-43b0-8044-6519d2b2029c requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:29:38.040901 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-32d83f30-b682-49d5-aaca-d9a652f94beb admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3092506 Nov 18 18:29:38.149954 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3616c78c-19e8-4978-b3ef-1383cc323cfb None None] Network d8199cdc-db2a-43b0-8044-6519d2b2029c requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:29:38.494407 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45542) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:38.499868 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1975268572-network', 'tenant_id': '1820d7056de64570bdc0a058dde3f241'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:29:38.520452 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Made reservation on behalf of 1820d7056de64570bdc0a058dde3f241 for: {'network': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:29:38.522707 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for network, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:38.531256 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:38.608068 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:38.611486 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:38.637107 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1330} {{(pid=102689) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 18:29:38.643637 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fab021d5-31c8-489d-9fad-c0454bafc15a,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:38.652131 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:38.652473 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.segments_db [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Added segment 32ec797d-c059-4b30-8f6e-33f96841b5b2 of type vlan for network 093ad6fc-329c-4785-8cd4-de7f5d55c0e7 Nov 18 18:29:38.655158 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:38.655540 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:38.655884 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:38.656245 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:38.656577 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:38.656908 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:38.657237 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:38.657564 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:38.657891 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:38.658214 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:38.658536 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:38.658856 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:38.699256 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8772714608550'] for network, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:38.723453 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508'] for network, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:38.724423 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:29:38.725254 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:38.751009 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.2555413 Nov 18 18:29:38.753870 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45544) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:38.758776 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.v2.base [None req-ed44a0c3-9816-4bda-b180-69a3237109dc admin admin] Request body: {'subnet': {'network_id': '093ad6fc-329c-4785-8cd4-de7f5d55c0e7', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1975268572-subnet', 'tenant_id': '1820d7056de64570bdc0a058dde3f241', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102688) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:29:38.780403 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed44a0c3-9816-4bda-b180-69a3237109dc admin admin] Made reservation on behalf of 1820d7056de64570bdc0a058dde3f241 for: {'subnet': 1} {{(pid=102688) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:29:38.782678 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ed44a0c3-9816-4bda-b180-69a3237109dc admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14505870'] for subnet, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:38.790155 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9884698b-da23-41b2-bace-f5923ae81537 admin admin] Pushing event updated for resources: {'Network': ['ID=093ad6fc-329c-4785-8cd4-de7f5d55c0e7,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:38.801190 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Network 093ad6fc-329c-4785-8cd4-de7f5d55c0e7 details requested by agent ovs-agent-dv-cinder-787764-6-iscsi with host dv-cinder-787764-6-iscsi {{(pid=102690) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 18:29:38.951060 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ed44a0c3-9816-4bda-b180-69a3237109dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-13993069', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14505888'] for subnet, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.003719 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed44a0c3-9816-4bda-b180-69a3237109dc admin admin] Pushing event updated for resources: {'Subnet': ['ID=ca45532f-23c1-4eb8-bd49-6228bfcfe2e9,revision_number=0']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:39.013679 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed44a0c3-9816-4bda-b180-69a3237109dc admin admin] Checking segment: {'id': '32ec797d-c059-4b30-8f6e-33f96841b5b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1330, 'network_id': '093ad6fc-329c-4785-8cd4-de7f5d55c0e7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102688) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:29:39.014568 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed44a0c3-9816-4bda-b180-69a3237109dc admin admin] Network hostable DHCP agents. Network: 093ad6fc-329c-4785-8cd4-de7f5d55c0e7, hostable agents: ['6c2665d4-7367-426d-8d58-a437b0c0516f'], hosted agents: [] {{(pid=102688) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 18:29:39.030422 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed44a0c3-9816-4bda-b180-69a3237109dc admin admin] Network 093ad6fc-329c-4785-8cd4-de7f5d55c0e7 is scheduled to be hosted by DHCP agent 6c2665d4-7367-426d-8d58-a437b0c0516f with binding_index 1 {{(pid=102688) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 18:29:39.038967 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.base_scheduler [None req-ed44a0c3-9816-4bda-b180-69a3237109dc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787764-6-iscsi, 093ad6fc-329c-4785-8cd4-de7f5d55c0e7) {{(pid=102688) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:29:39.043099 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed44a0c3-9816-4bda-b180-69a3237109dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102688) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:29:39.043736 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ed44a0c3-9816-4bda-b180-69a3237109dc admin admin] Publish callbacks [] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.051433 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8195d2be-2d0d-494f-af2b-7fc53547bb69 None None] Network 093ad6fc-329c-4785-8cd4-de7f5d55c0e7 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:29:39.062035 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-ed44a0c3-9816-4bda-b180-69a3237109dc admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3070345 Nov 18 18:29:39.077360 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45554) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:39.100765 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.187494 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-68f72c42-0f9d-4a3f-bcc4-af150575e547 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.197690 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0eec5fbd-4746-4d7b-a471-d1e37e2954c3 None None] Network 093ad6fc-329c-4785-8cd4-de7f5d55c0e7 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:29:39.274559 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-68f72c42-0f9d-4a3f-bcc4-af150575e547 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.279590 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-68f72c42-0f9d-4a3f-bcc4-af150575e547 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.318180 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-68f72c42-0f9d-4a3f-bcc4-af150575e547 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=eb23e538dad94d7a91b97827579c8b9f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2397339 Nov 18 18:29:39.320721 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45562) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:39.328495 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f72c42-0f9d-4a3f-bcc4-af150575e547 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea001690-4809-4111-93ee-a5c687f01149,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:39.374119 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-94b038bf-6035-4f12-9e1e-d186b6297059 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.395357 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-94b038bf-6035-4f12-9e1e-d186b6297059 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.442292 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-94b038bf-6035-4f12-9e1e-d186b6297059 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.445259 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-94b038bf-6035-4f12-9e1e-d186b6297059 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.449124 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-94b038bf-6035-4f12-9e1e-d186b6297059 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ea001690-4809-4111-93ee-a5c687f01149 HTTP/1.1" status: 204 len: 168 time: 0.1246676 Nov 18 18:29:39.454410 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94b038bf-6035-4f12-9e1e-d186b6297059 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea001690-4809-4111-93ee-a5c687f01149,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:39.716124 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45572) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:39.729364 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bd0732d6-4444-4bf6-b520-e1bb6e8c18c1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.802233 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bd0732d6-4444-4bf6-b520-e1bb6e8c18c1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.806091 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bd0732d6-4444-4bf6-b520-e1bb6e8c18c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.846437 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-bd0732d6-4444-4bf6-b520-e1bb6e8c18c1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a7de9009b1e745c4811e549649521ab6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1291773 Nov 18 18:29:39.847652 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd0732d6-4444-4bf6-b520-e1bb6e8c18c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e6dd2ad-893d-4253-9b84-3871c0c2198b,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:39.850235 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45574) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:39.897605 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-15594fa3-7cbb-4f23-989d-88aa41480787 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.918527 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-15594fa3-7cbb-4f23-989d-88aa41480787 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.963347 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-15594fa3-7cbb-4f23-989d-88aa41480787 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.965965 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-15594fa3-7cbb-4f23-989d-88aa41480787 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:39.967668 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-15594fa3-7cbb-4f23-989d-88aa41480787 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9e6dd2ad-893d-4253-9b84-3871c0c2198b HTTP/1.1" status: 204 len: 168 time: 0.1159716 Nov 18 18:29:39.975326 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15594fa3-7cbb-4f23-989d-88aa41480787 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e6dd2ad-893d-4253-9b84-3871c0c2198b,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:40.192441 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:41.486724 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45630) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:41.588135 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c094f4c7-9011-4eca-b777-7a6fd9c1089a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:41.662339 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c094f4c7-9011-4eca-b777-7a6fd9c1089a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:41.665820 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c094f4c7-9011-4eca-b777-7a6fd9c1089a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:41.703444 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-c094f4c7-9011-4eca-b777-7a6fd9c1089a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=40c9d42ee049494bbe0dcf6251a716fd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2156696 Nov 18 18:29:41.704386 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c094f4c7-9011-4eca-b777-7a6fd9c1089a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c0ae0bd-67df-43be-9865-8f1a2464425d,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:41.706221 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45634) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:41.754994 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5ffc4ed7-3995-4c31-89d7-41a0c89206b3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:41.775680 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5ffc4ed7-3995-4c31-89d7-41a0c89206b3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:41.821068 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5ffc4ed7-3995-4c31-89d7-41a0c89206b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:41.823724 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-5ffc4ed7-3995-4c31-89d7-41a0c89206b3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:41.824892 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-5ffc4ed7-3995-4c31-89d7-41a0c89206b3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3c0ae0bd-67df-43be-9865-8f1a2464425d HTTP/1.1" status: 204 len: 168 time: 0.1170580 Nov 18 18:29:41.832185 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ffc4ed7-3995-4c31-89d7-41a0c89206b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c0ae0bd-67df-43be-9865-8f1a2464425d,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:42.071548 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45640) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:42.084565 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f839bb32-445e-474d-969c-a8200e865abe admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:42.164322 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f839bb32-445e-474d-969c-a8200e865abe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:42.168736 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-f839bb32-445e-474d-969c-a8200e865abe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:42.206923 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-f839bb32-445e-474d-969c-a8200e865abe admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1c2cfa857f514adfaa330978750eaf86&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1342373 Nov 18 18:29:42.207892 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f839bb32-445e-474d-969c-a8200e865abe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=296399aa-d791-4c4f-8827-fa55d741202d,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:42.209788 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45646) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:42.261621 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a3a0d433-1041-40b1-850d-d3baf5a4300b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:42.283333 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a3a0d433-1041-40b1-850d-d3baf5a4300b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:42.330734 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a3a0d433-1041-40b1-850d-d3baf5a4300b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:42.333624 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-a3a0d433-1041-40b1-850d-d3baf5a4300b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:42.334820 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-a3a0d433-1041-40b1-850d-d3baf5a4300b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/296399aa-d791-4c4f-8827-fa55d741202d HTTP/1.1" status: 204 len: 168 time: 0.1240468 Nov 18 18:29:42.342576 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3a0d433-1041-40b1-850d-d3baf5a4300b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=296399aa-d791-4c4f-8827-fa55d741202d,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:47.082514 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45754) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:47.186718 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.261264 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.266197 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.299338 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=57179d9e7171449799baa8eff15350be&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2156515 Nov 18 18:29:47.302076 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45762) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:47.308592 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d85f360-7d1c-4df3-b1e2-dac3151e56be,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:47.318740 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:47.319099 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:47.319519 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:47.319878 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:47.320131 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:47.320470 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:47.320804 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:47.321137 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:47.321468 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:47.321804 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:47.322481 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:47.322780 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69cb52ab-efec-46d6-978c-40c72ad357da admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:29:47.359504 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-eeda9bf8-d71c-405f-907e-5be138b40308 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.383722 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-eeda9bf8-d71c-405f-907e-5be138b40308 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.430039 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-eeda9bf8-d71c-405f-907e-5be138b40308 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.432677 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-eeda9bf8-d71c-405f-907e-5be138b40308 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.433907 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-eeda9bf8-d71c-405f-907e-5be138b40308 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/5d85f360-7d1c-4df3-b1e2-dac3151e56be HTTP/1.1" status: 204 len: 168 time: 0.1304116 Nov 18 18:29:47.442852 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeda9bf8-d71c-405f-907e-5be138b40308 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d85f360-7d1c-4df3-b1e2-dac3151e56be,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:47.695990 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45772) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:47.709967 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5ca79919-466b-4775-bb62-4c5db24e3c62 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.783799 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5ca79919-466b-4775-bb62-4c5db24e3c62 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.787440 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-5ca79919-466b-4775-bb62-4c5db24e3c62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.824721 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-5ca79919-466b-4775-bb62-4c5db24e3c62 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=cce980173bb24c958df998ebcd9b11e5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1276178 Nov 18 18:29:47.827523 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45774) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:47.829165 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca79919-466b-4775-bb62-4c5db24e3c62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=94f2a69d-7ce7-4b75-beda-50f723254a0a,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:47.873920 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4b123f17-7e1e-4407-b5ec-218d2a99a9b0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.894507 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4b123f17-7e1e-4407-b5ec-218d2a99a9b0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.939785 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4b123f17-7e1e-4407-b5ec-218d2a99a9b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.942436 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4b123f17-7e1e-4407-b5ec-218d2a99a9b0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:47.943566 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-4b123f17-7e1e-4407-b5ec-218d2a99a9b0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/94f2a69d-7ce7-4b75-beda-50f723254a0a HTTP/1.1" status: 204 len: 168 time: 0.1150370 Nov 18 18:29:47.950841 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b123f17-7e1e-4407-b5ec-218d2a99a9b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=94f2a69d-7ce7-4b75-beda-50f723254a0a,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:51.173305 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:52.555667 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45910) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:52.598349 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_v2 [None req-757fb266-420b-4002-913d-5169649f3b25 admin admin] Deleting subnet a2c87dea-60ea-4426-afab-c3f705d00eef {{(pid=102689) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:29:52.601757 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-757fb266-420b-4002-913d-5169649f3b25 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:52.637882 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-757fb266-420b-4002-913d-5169649f3b25 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12724830'] for subnet, precommit_delete_associations {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:52.675582 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-757fb266-420b-4002-913d-5169649f3b25 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:52.724157 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-757fb266-420b-4002-913d-5169649f3b25 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12723963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14479099'] for subnet, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:52.750267 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-757fb266-420b-4002-913d-5169649f3b25 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a2c87dea-60ea-4426-afab-c3f705d00eef,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:52.752243 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-757fb266-420b-4002-913d-5169649f3b25 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for subnet, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:52.755461 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-757fb266-420b-4002-913d-5169649f3b25 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/a2c87dea-60ea-4426-afab-c3f705d00eef HTTP/1.1" status: 204 len: 168 time: 0.1987715 Nov 18 18:29:52.757910 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45912) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:52.827698 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:52.903439 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:52.924670 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d8199cdc-db2a-43b0-8044-6519d2b2029c']}} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:52.934653 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8b6d9f22-bf33-4dbc-8d3e-bd009420cb9b') {'for_net_delete': True} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:52.934874 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8b6d9f22-bf33-4dbc-8d3e-bd009420cb9b') {} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:52.948248 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12724807'] for segment, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:52.962224 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:52.968998 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] Releasing vlan 1347 on physical network physnet1 to pool {{(pid=102689) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:29:52.969378 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12723877'] for segment, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: Traceback (most recent call last): Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: timer() Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: cb(*args, **kw) Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: return func(*args, **kwargs) Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: self._notify() Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: self.callback(batched_events) Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: event.method(event) Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: return f(self, *a, **k) Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._get(url).json() Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: return self.request(url, 'GET', **kwargs) Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:29:52.971058 dv-cinder-787764-6-iscsi neutron-server[102689]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:29:53.027573 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.032990 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.036595 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] 10.222.0.82 "DELETE /v2.0/networks/d8199cdc-db2a-43b0-8044-6519d2b2029c HTTP/1.1" status: 204 len: 168 time: 0.2777534 Nov 18 18:29:53.039545 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45918) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:53.047962 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac7f8918-cb02-440d-b2b8-0370f484219b admin admin] Pushing event deleted for resources: {'Network': ['ID=d8199cdc-db2a-43b0-8044-6519d2b2029c,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:53.092791 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_v2 [None req-3ae7e484-6af1-4af7-b884-c31f7dcffbfa admin admin] Deleting subnet ca45532f-23c1-4eb8-bd49-6228bfcfe2e9 {{(pid=102688) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:29:53.096703 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ae7e484-6af1-4af7-b884-c31f7dcffbfa admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.133710 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ae7e484-6af1-4af7-b884-c31f7dcffbfa admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14253791'] for subnet, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.172389 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ae7e484-6af1-4af7-b884-c31f7dcffbfa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.228643 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ae7e484-6af1-4af7-b884-c31f7dcffbfa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-13993132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14505899'] for subnet, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.253865 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ae7e484-6af1-4af7-b884-c31f7dcffbfa admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ca45532f-23c1-4eb8-bd49-6228bfcfe2e9,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:53.258246 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-3ae7e484-6af1-4af7-b884-c31f7dcffbfa admin admin] Publish callbacks [] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.261428 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-3ae7e484-6af1-4af7-b884-c31f7dcffbfa admin admin] 10.222.0.82 "DELETE /v2.0/subnets/ca45532f-23c1-4eb8-bd49-6228bfcfe2e9 HTTP/1.1" status: 204 len: 168 time: 0.2205844 Nov 18 18:29:53.263904 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 45924) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:53.328281 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.406546 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.426501 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['093ad6fc-329c-4785-8cd4-de7f5d55c0e7']}} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:53.435506 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '32ec797d-c059-4b30-8f6e-33f96841b5b2') {'for_net_delete': True} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:53.435802 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '32ec797d-c059-4b30-8f6e-33f96841b5b2') {} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:29:53.444920 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14253766'] for segment, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.457937 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.463799 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] Releasing vlan 1330 on physical network physnet1 to pool {{(pid=102688) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:29:53.464212 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-13993202'] for segment, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: Traceback (most recent call last): Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: timer() Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: cb(*args, **kw) Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: return func(*args, **kwargs) Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: self._notify() Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: self.callback(batched_events) Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: event.method(event) Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: return f(self, *a, **k) Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._get(url).json() Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: return self.request(url, 'GET', **kwargs) Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:29:53.465906 dv-cinder-787764-6-iscsi neutron-server[102688]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:29:53.750909 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.757934 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:53.761119 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] 10.222.0.82 "DELETE /v2.0/networks/093ad6fc-329c-4785-8cd4-de7f5d55c0e7 HTTP/1.1" status: 204 len: 168 time: 0.4962835 Nov 18 18:29:53.770897 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb66e2cc-a1fe-41c6-9d82-eaba4bbfc63d admin admin] Pushing event deleted for resources: {'Network': ['ID=093ad6fc-329c-4785-8cd4-de7f5d55c0e7,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:53.918065 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45928) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:53.956452 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-76bdc731-18d6-4483-abd8-d98fc7e42ddc admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4b1c6330fc894b5a8ce788cffb0ab0be&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0370715 Nov 18 18:29:53.958668 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45930) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:54.004357 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-21a4e058-e230-4ace-a5e0-baa8d14d57a9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:54.028702 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-21a4e058-e230-4ace-a5e0-baa8d14d57a9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:54.073830 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-21a4e058-e230-4ace-a5e0-baa8d14d57a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:54.076552 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-21a4e058-e230-4ace-a5e0-baa8d14d57a9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:54.078333 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-21a4e058-e230-4ace-a5e0-baa8d14d57a9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f0881c87-670c-4272-b3fc-f187c9303065 HTTP/1.1" status: 204 len: 168 time: 0.1186736 Nov 18 18:29:54.085459 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21a4e058-e230-4ace-a5e0-baa8d14d57a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0881c87-670c-4272-b3fc-f187c9303065,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:54.387888 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45950) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:54.430681 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-0603ac3e-b764-46a3-9705-59dc5da9b348 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1820d7056de64570bdc0a058dde3f241&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0414760 Nov 18 18:29:54.433100 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45954) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:54.500428 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b8bafc8-2080-4ce7-ae3b-be21c3055c6c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:54.514222 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b8bafc8-2080-4ce7-ae3b-be21c3055c6c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:54.559905 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b8bafc8-2080-4ce7-ae3b-be21c3055c6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:54.563241 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-9b8bafc8-2080-4ce7-ae3b-be21c3055c6c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:54.564496 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-9b8bafc8-2080-4ce7-ae3b-be21c3055c6c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fab021d5-31c8-489d-9fad-c0454bafc15a HTTP/1.1" status: 204 len: 168 time: 0.1304157 Nov 18 18:29:54.572650 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b8bafc8-2080-4ce7-ae3b-be21c3055c6c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fab021d5-31c8-489d-9fad-c0454bafc15a,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:55.568172 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 45994) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:55.671127 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-92fefeb2-001b-4e70-aa49-9977d1804bcd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:55.748090 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-92fefeb2-001b-4e70-aa49-9977d1804bcd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:55.752941 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-92fefeb2-001b-4e70-aa49-9977d1804bcd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:55.761876 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46000) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:55.791836 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92fefeb2-001b-4e70-aa49-9977d1804bcd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb0efbfe-59eb-49e7-b71d-aa5effe56a15,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:55.798523 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-92fefeb2-001b-4e70-aa49-9977d1804bcd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=cc8446e7c5a943e68e3d266944e6463b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2267222 Nov 18 18:29:55.799476 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46004) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:55.847125 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-84de6bb1-f3d1-4211-b71f-2d323d29da67 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:55.877802 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fbc3053e-14e2-45e3-a463-290a84c4d2bf admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:55.880632 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-84de6bb1-f3d1-4211-b71f-2d323d29da67 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:55.950525 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-84de6bb1-f3d1-4211-b71f-2d323d29da67 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:55.953101 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-84de6bb1-f3d1-4211-b71f-2d323d29da67 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:55.954209 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-84de6bb1-f3d1-4211-b71f-2d323d29da67 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bb0efbfe-59eb-49e7-b71d-aa5effe56a15 HTTP/1.1" status: 204 len: 168 time: 0.1543915 Nov 18 18:29:55.967427 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84de6bb1-f3d1-4211-b71f-2d323d29da67 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb0efbfe-59eb-49e7-b71d-aa5effe56a15,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:56.002958 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fbc3053e-14e2-45e3-a463-290a84c4d2bf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.007690 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-fbc3053e-14e2-45e3-a463-290a84c4d2bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.048866 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-fbc3053e-14e2-45e3-a463-290a84c4d2bf admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b0b783396ca04325a22afb13ed8532e7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2858377 Nov 18 18:29:56.050758 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc3053e-14e2-45e3-a463-290a84c4d2bf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b90fe827-da0f-4052-bf74-067a77e11fcb,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:56.051515 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46008) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:56.102300 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7a5b5117-654a-4951-a337-1b60f80684e2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.124766 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7a5b5117-654a-4951-a337-1b60f80684e2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.170818 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7a5b5117-654a-4951-a337-1b60f80684e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.177093 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7a5b5117-654a-4951-a337-1b60f80684e2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.178091 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-7a5b5117-654a-4951-a337-1b60f80684e2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b90fe827-da0f-4052-bf74-067a77e11fcb HTTP/1.1" status: 204 len: 168 time: 0.1254981 Nov 18 18:29:56.187584 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a5b5117-654a-4951-a337-1b60f80684e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b90fe827-da0f-4052-bf74-067a77e11fcb,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:56.506673 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46028) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:56.520452 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d7ad6482-dd04-4f8a-b613-bc6841bab2a2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.593494 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d7ad6482-dd04-4f8a-b613-bc6841bab2a2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.597618 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-d7ad6482-dd04-4f8a-b613-bc6841bab2a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.639600 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-d7ad6482-dd04-4f8a-b613-bc6841bab2a2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3d7449d304ce450ebeb900a5e8df365d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1317785 Nov 18 18:29:56.640519 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7ad6482-dd04-4f8a-b613-bc6841bab2a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e6b0522-2308-4583-8335-15e73d351e0a,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:56.642429 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46034) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:56.690423 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d4d86a85-3fc5-4927-8745-0dfcc03c80f8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.711467 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d4d86a85-3fc5-4927-8745-0dfcc03c80f8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.759051 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d4d86a85-3fc5-4927-8745-0dfcc03c80f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.761842 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d4d86a85-3fc5-4927-8745-0dfcc03c80f8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:56.766399 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-d4d86a85-3fc5-4927-8745-0dfcc03c80f8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9e6b0522-2308-4583-8335-15e73d351e0a HTTP/1.1" status: 204 len: 168 time: 0.1195834 Nov 18 18:29:56.771519 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4d86a85-3fc5-4927-8745-0dfcc03c80f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e6b0522-2308-4583-8335-15e73d351e0a,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:57.096395 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46046) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:57.110198 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-04ea459a-44e0-4957-aa67-a35f842a4e56 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:57.189523 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-04ea459a-44e0-4957-aa67-a35f842a4e56 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:57.193322 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-04ea459a-44e0-4957-aa67-a35f842a4e56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:57.230926 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-04ea459a-44e0-4957-aa67-a35f842a4e56 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=38dcdf3869e44a27a0542aefae5a4070&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1334100 Nov 18 18:29:57.232146 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04ea459a-44e0-4957-aa67-a35f842a4e56 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2ff835c-6cc6-48b3-b0c9-9722561aa7b4,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:29:57.233815 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46048) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:29:57.292569 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-67dbe0e9-79c5-4a22-9fa1-2064e444c96b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:57.316435 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-67dbe0e9-79c5-4a22-9fa1-2064e444c96b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:57.365280 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-67dbe0e9-79c5-4a22-9fa1-2064e444c96b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:57.368059 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-67dbe0e9-79c5-4a22-9fa1-2064e444c96b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:29:57.369207 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-67dbe0e9-79c5-4a22-9fa1-2064e444c96b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c2ff835c-6cc6-48b3-b0c9-9722561aa7b4 HTTP/1.1" status: 204 len: 168 time: 0.1326020 Nov 18 18:29:57.377487 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67dbe0e9-79c5-4a22-9fa1-2064e444c96b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2ff835c-6cc6-48b3-b0c9-9722561aa7b4,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:00.477174 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:30:04.000217 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a8b52f0b-63f4-4f60-ba3c-950cb4926ed9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:06.440700 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3ad9dc34-c0fe-479d-b662-506b04495cf8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:06.949177 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46254) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:30:07.053017 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-939abadf-2757-419a-8522-413db5e0540a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:07.124839 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-939abadf-2757-419a-8522-413db5e0540a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:07.129310 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-939abadf-2757-419a-8522-413db5e0540a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:07.168697 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-939abadf-2757-419a-8522-413db5e0540a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3c12d2407a704879b94349b3dbd00828&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2183807 Nov 18 18:30:07.169573 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-939abadf-2757-419a-8522-413db5e0540a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2196d26e-54ff-4fc4-8978-d00c2db05c7d,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:07.171377 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46258) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:30:07.221919 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d8102aba-3df4-4d4f-894e-c8eb909affdf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:07.243810 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d8102aba-3df4-4d4f-894e-c8eb909affdf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:07.289684 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d8102aba-3df4-4d4f-894e-c8eb909affdf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:07.292599 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-d8102aba-3df4-4d4f-894e-c8eb909affdf admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:07.293880 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-d8102aba-3df4-4d4f-894e-c8eb909affdf admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2196d26e-54ff-4fc4-8978-d00c2db05c7d HTTP/1.1" status: 204 len: 168 time: 0.1208153 Nov 18 18:30:07.302106 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8102aba-3df4-4d4f-894e-c8eb909affdf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2196d26e-54ff-4fc4-8978-d00c2db05c7d,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:07.733199 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:09.077566 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:10.194632 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:21.167455 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:23.051281 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7546391-891c-4310-865a-553c2dd3a970 req-c11d99ba-6832-42ec-922f-17633a796d27 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:23.052737 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a7546391-891c-4310-865a-553c2dd3a970 req-c11d99ba-6832-42ec-922f-17633a796d27 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0510650 Nov 18 18:30:23.101583 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a7546391-891c-4310-865a-553c2dd3a970 req-24f4c1f1-68af-441e-8360-2cb5be44121a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421643 Nov 18 18:30:24.214962 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddbf1520-9572-4835-9c75-4a7a28a20f79 req-a8b90977-3c4f-405c-82d1-f1bd9ef04aa9 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:24.216445 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ddbf1520-9572-4835-9c75-4a7a28a20f79 req-a8b90977-3c4f-405c-82d1-f1bd9ef04aa9 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0473907 Nov 18 18:30:24.265165 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ddbf1520-9572-4835-9c75-4a7a28a20f79 req-ec73c0d8-f188-4b84-8910-c1d61d9924fb tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428030 Nov 18 18:30:25.377886 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c3a6aa8-d5a5-4070-a93f-044e63cee166 req-1d4973f9-926e-4925-8aab-d17d64882bb5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:25.379349 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9c3a6aa8-d5a5-4070-a93f-044e63cee166 req-1d4973f9-926e-4925-8aab-d17d64882bb5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0482121 Nov 18 18:30:25.429932 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9c3a6aa8-d5a5-4070-a93f-044e63cee166 req-08acea91-6cf5-430d-9471-e2ac36237d00 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447197 Nov 18 18:30:26.541918 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-975fda04-3a99-4e47-8be6-58ad09f7f4c5 req-44b636f4-74df-4b5d-bc4d-15d3fc8a33ca tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:26.543400 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-975fda04-3a99-4e47-8be6-58ad09f7f4c5 req-44b636f4-74df-4b5d-bc4d-15d3fc8a33ca tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0477643 Nov 18 18:30:26.596830 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-975fda04-3a99-4e47-8be6-58ad09f7f4c5 req-7411cbe4-49b2-4085-933c-afa0391ae706 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430210 Nov 18 18:30:27.087204 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d18eeb-7513-43bc-9136-be591d13eadc req-51f6f511-1737-4e30-bad6-442958505c7a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:27.088651 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-92d18eeb-7513-43bc-9136-be591d13eadc req-51f6f511-1737-4e30-bad6-442958505c7a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 946 time: 0.0461862 Nov 18 18:30:27.180367 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Deleting port ccea3eb1-d1c4-4326-b70b-95e79feb632e {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:30:27.180700 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:27.265121 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] For port ccea3eb1-d1c4-4326-b70b-95e79feb632e, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=ccea3eb1-d1c4-4326-b70b-95e79feb632e,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:30:27.265478 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:27.435576 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:27.435843 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:27.436925 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Floating IP c515b9f1-ac39-4719-b3db-b5ca3ba6d43f disassociated. External IP: 172.27.1.222, port: ccea3eb1-d1c4-4326-b70b-95e79feb632e. Nov 18 18:30:27.437296 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Calling delete_port for ccea3eb1-d1c4-4326-b70b-95e79feb632e owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:30:27.574098 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:27.608943 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event deleted for resources: {'Port': ['ID=ccea3eb1-d1c4-4326-b70b-95e79feb632e,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:27.729769 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a7b060a9-c7ad-4baa-aec5-b557673a09bc req-0d029b74-8987-48f0-a002-4dd0044b972b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=024f682c-8986-4663-a691-45b3b44d7add HTTP/1.1" status: 200 len: 210 time: 0.0582075 Nov 18 18:30:27.745690 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Router ae4f264c-d828-44a7-ab29-e11545372d21 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:30:27.863772 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:30:27.874226 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c16d39f-02b8-4422-8455-09219ab8d43d None None] Sync routers for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:30:27.893776 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c16d39f-02b8-4422-8455-09219ab8d43d None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:30:27.894471 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-9c16d39f-02b8-4422-8455-09219ab8d43d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:30:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:30:27.904433 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] No DVR routers for this DVR port ccea3eb1-d1c4-4326-b70b-95e79feb632e on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:30:27.908963 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:27.912765 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-92d18eeb-7513-43bc-9136-be591d13eadc req-f32851e2-16a0-4e98-96f0-20222fccbb50 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "DELETE /v2.0/ports/ccea3eb1-d1c4-4326-b70b-95e79feb632e HTTP/1.1" status: 204 len: 173 time: 0.8166921 Nov 18 18:30:27.913232 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '024f682c-8986-4663-a691-45b3b44d7add', 'name': 'network-vif-deleted', 'tag': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:30:27.915692 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d38f2df6-5ebe-4cd3-884b-d92bbdbe77a6" -d '{"events": [{"server_uuid": "024f682c-8986-4663-a691-45b3b44d7add", "name": "network-vif-deleted", "tag": "ccea3eb1-d1c4-4326-b70b-95e79feb632e"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:30:27.967755 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:30:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64850a87-46c7-44ea-b104-7c308c14f782 x-openstack-request-id: req-64850a87-46c7-44ea-b104-7c308c14f782 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:30:27.968495 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "024f682c-8986-4663-a691-45b3b44d7add", "name": "network-vif-deleted", "tag": "ccea3eb1-d1c4-4326-b70b-95e79feb632e", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:30:27.968911 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-64850a87-46c7-44ea-b104-7c308c14f782 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:30:27.969729 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '024f682c-8986-4663-a691-45b3b44d7add', 'name': 'network-vif-deleted', 'tag': 'ccea3eb1-d1c4-4326-b70b-95e79feb632e', 'status': 'completed', 'code': 200} Nov 18 18:30:28.036037 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-9c16d39f-02b8-4422-8455-09219ab8d43d None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:30:28.248615 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-9c16d39f-02b8-4422-8455-09219ab8d43d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:30:28.277615 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c16d39f-02b8-4422-8455-09219ab8d43d None None] Checking router: ae4f264c-d828-44a7-ab29-e11545372d21 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:30:28.285730 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c16d39f-02b8-4422-8455-09219ab8d43d None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:30:28.286316 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-9c16d39f-02b8-4422-8455-09219ab8d43d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:30:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:30:28.508719 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-9c16d39f-02b8-4422-8455-09219ab8d43d None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:30:28.703849 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-9c16d39f-02b8-4422-8455-09219ab8d43d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:30:28.730254 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c16d39f-02b8-4422-8455-09219ab8d43d None None] The sync data for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi is: [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:30:28.960613 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e921ca7-e697-40b8-901a-662b72693104 None None] New status for floating IP c515b9f1-ac39-4719-b3db-b5ca3ba6d43f: DOWN {{(pid=102691) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:30:29.009371 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-566adbbe-818d-40fe-a499-a014dae8c032 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1203552063&fields=id&tenant_id=d08a29a317934e72a71b69340d23cd0b HTTP/1.1" status: 200 len: 267 time: 0.0556710 Nov 18 18:30:29.121897 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-3ba64304-dff9-4cf7-9125-4438f42bb4d3 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:29.123343 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-3ba64304-dff9-4cf7-9125-4438f42bb4d3 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 811 time: 0.1072354 Nov 18 18:30:29.138233 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-cc2a65eb-3ee5-41cc-911e-bad599dbbed9 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/quotas/d08a29a317934e72a71b69340d23cd0b HTTP/1.1" status: 200 len: 375 time: 0.0091288 Nov 18 18:30:29.187342 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-aa94b7e7-5e4d-4f09-9144-4d729a40899c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0440402 Nov 18 18:30:29.292622 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-1e4c83ef-727a-4c4b-9052-b951d75a9855 service neutron] 10.222.0.82 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929687 Nov 18 18:30:29.380536 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-9661e4d0-f193-4820-ab59-625788f7871e service neutron] 10.222.0.82 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814564 Nov 18 18:30:30.673597 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d194761f-9475-4dd1-9cd6-8f17c6df4358 req-e68c2b0e-8c94-4bad-a7d7-f0478bd7c7bc tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 210 time: 0.0260165 Nov 18 18:30:31.385450 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46398) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:30:31.485892 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b646186a-8740-49d8-8c97-b28e8ad00206 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:31.559798 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b646186a-8740-49d8-8c97-b28e8ad00206 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:31.563336 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b646186a-8740-49d8-8c97-b28e8ad00206 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:31.598590 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-b646186a-8740-49d8-8c97-b28e8ad00206 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=88fb9d5c3e424674aed14675a37af557&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2120888 Nov 18 18:30:31.600567 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b646186a-8740-49d8-8c97-b28e8ad00206 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2556d79a-8729-4b4d-a2d3-90686dc57be5,revision_number=1']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:31.602154 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46402) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:30:31.653555 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4a6058a3-2526-4f67-893c-5d80ef984a44 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:31.676665 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4a6058a3-2526-4f67-893c-5d80ef984a44 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:31.733913 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4a6058a3-2526-4f67-893c-5d80ef984a44 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:31.736519 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-4a6058a3-2526-4f67-893c-5d80ef984a44 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:31.737644 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-4a6058a3-2526-4f67-893c-5d80ef984a44 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2556d79a-8729-4b4d-a2d3-90686dc57be5 HTTP/1.1" status: 204 len: 168 time: 0.1345103 Nov 18 18:30:31.754092 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3bb72d93-2a07-4ca8-864b-c45383856d64 req-875a9f50-4520-4a66-8ac3-966ec95690c2 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 210 time: 0.0321579 Nov 18 18:30:31.764457 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a6058a3-2526-4f67-893c-5d80ef984a44 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2556d79a-8729-4b4d-a2d3-90686dc57be5,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:31.891142 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device ccea3eb1-d1c4-4326-b70b-95e79feb632e no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:30:31.915175 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: ccea3eb1-d1c4-4326-b70b-95e79feb632e {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:30:31.915428 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device ccea3eb1-d1c4-4326-b70b-95e79feb632e not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:30:32.868456 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-161be61d-1908-4bbe-916f-800fcdebfd06 req-1ae125f9-3e89-4452-b9f2-6e82ca98f876 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 210 time: 0.0483229 Nov 18 18:30:33.948724 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b0618b69-3dc1-4b5a-9771-be0b6d239c50 req-867f4280-3295-47cb-a70c-6d098efbc8c3 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 210 time: 0.0356491 Nov 18 18:30:34.013642 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-84099514-691d-49f8-a70b-497a7b23c09e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:35.043156 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4c9ad611-f413-4140-b333-fedc1b1dcd64 req-a7c230d4-ecc6-4b91-b429-b8a0b6204e81 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 210 time: 0.0280299 Nov 18 18:30:36.139592 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d9e31219-2ba0-469e-8404-954caeb68488 req-572f2392-1326-4bda-a4fd-343dd1f90e7a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 210 time: 0.0260568 Nov 18 18:30:36.443745 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-091f0c35-f36c-44b1-9640-1742bb744cbe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:37.272671 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-bc5c7d0e-7ade-4bef-b0cc-2e3476c83fd1 req-6330d2cb-5a6f-46e0-aca7-3c9cf6d00660 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 210 time: 0.0538001 Nov 18 18:30:37.396691 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-3f55443d-5396-4927-a926-52ea4c8549e4 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:37.398499 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-3f55443d-5396-4927-a926-52ea4c8549e4 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 811 time: 0.1219378 Nov 18 18:30:37.472260 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-52f9ba10-bca0-4ff3-a337-12f75064aa3b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d08a29a317934e72a71b69340d23cd0b HTTP/1.1" status: 200 len: 380 time: 0.0591495 Nov 18 18:30:37.477832 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:30:37.483465 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'port': {'device_id': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'admin_state_up': True, 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'security_groups': ['dd44e10b-bbd9-463d-98f3-ddfd17eace36']}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:30:37.593087 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Made reservation on behalf of d08a29a317934e72a71b69340d23cd0b for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:30:37.596726 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:37.726801 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Allocated IP 172.20.0.6 (1cf7f705-4c7c-4525-bcfb-71db85eb96a0/3cd0c89d-cb17-425f-b060-6f88dbc2e31b/689cc7a5-aee5-4e14-b7ee-55f33822a02c) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:30:37.737039 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:37.873162 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:37.906875 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:37.949992 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:30:37.953147 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:30:37.955832 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:30:37.983078 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'Port': ['ID=689cc7a5-aee5-4e14-b7ee-55f33822a02c,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:38.018880 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:38.019520 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:38.037398 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-f157245d-d150-40e8-a892-a21ec3e8aa70 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5582228 Nov 18 18:30:38.199589 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-5783db8d-3b46-48df-ba77-01dd5e3810dd None None] Provisioning complete for port 689cc7a5-aee5-4e14-b7ee-55f33822a02c triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:30:38.199979 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5783db8d-3b46-48df-ba77-01dd5e3810dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:38.237125 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-5783db8d-3b46-48df-ba77-01dd5e3810dd None None] Port 689cc7a5-aee5-4e14-b7ee-55f33822a02c cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:30:38.400463 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835ee3ed-c704-4909-93cf-0139f53052d9 req-b9bc086d-66e7-4029-83fb-20797a494026 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:38.402187 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-835ee3ed-c704-4909-93cf-0139f53052d9 req-b9bc086d-66e7-4029-83fb-20797a494026 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 931 time: 0.0498335 Nov 18 18:30:38.455665 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-835ee3ed-c704-4909-93cf-0139f53052d9 req-79830a08-8b9f-4222-b2e8-39675778db17 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475755 Nov 18 18:30:39.081293 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:39.292404 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Request body: {'port': {'device_id': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:30:39.343182 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:39.836879 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8bc4f55-30f1-4f21-862a-8d8a42fcf884 req-5bf5898b-5658-48b7-94df-6ee80efc300c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:39.838356 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d8bc4f55-30f1-4f21-862a-8d8a42fcf884 req-5bf5898b-5658-48b7-94df-6ee80efc300c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 931 time: 0.3111095 Nov 18 18:30:39.907456 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 689cc7a5-aee5-4e14-b7ee-55f33822a02c {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:30:39.922566 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:39.932439 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d8bc4f55-30f1-4f21-862a-8d8a42fcf884 req-a4294ae7-ccf6-46c2-92cc-a7cfc7b4eb4b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0855141 Nov 18 18:30:39.939346 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Transition to ACTIVE for port object 689cc7a5-aee5-4e14-b7ee-55f33822a02c will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:30:39.943472 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:39.995088 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Pushing event updated for resources: {'Port': ['ID=689cc7a5-aee5-4e14-b7ee-55f33822a02c,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:40.020108 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:40.020369 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:40.020716 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:40.021059 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:40.021394 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:40.021743 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:40.022050 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:40.022381 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:40.022711 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:40.023038 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:40.023366 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:40.023692 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:40.073644 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Attempting to bind port 689cc7a5-aee5-4e14-b7ee-55f33822a02c on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:30:40.073973 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Attempting to bind port 689cc7a5-aee5-4e14-b7ee-55f33822a02c by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:30:40.074278 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Attempting to bind port 689cc7a5-aee5-4e14-b7ee-55f33822a02c on network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:30:40.079132 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Port 689cc7a5-aee5-4e14-b7ee-55f33822a02c on network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:30:40.079447 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Attempting to bind port 689cc7a5-aee5-4e14-b7ee-55f33822a02c on network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:30:40.084402 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 30, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:30:40.084735 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Checking segment: {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:30:40.085118 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Bound using segment: {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:30:40.085536 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Bound port: 689cc7a5-aee5-4e14-b7ee-55f33822a02c, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:30:40.085885 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:40.148874 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] For port 689cc7a5-aee5-4e14-b7ee-55f33822a02c, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:30:40.152462 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] For port 689cc7a5-aee5-4e14-b7ee-55f33822a02c, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=689cc7a5-aee5-4e14-b7ee-55f33822a02c,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:30:40.157549 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:40.192187 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:40.192808 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:40.194211 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] 10.222.0.31 "PUT /v2.0/ports/689cc7a5-aee5-4e14-b7ee-55f33822a02c HTTP/1.1" status: 200 len: 1093 time: 0.9062693 Nov 18 18:30:40.194654 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'tag': '689cc7a5-aee5-4e14-b7ee-55f33822a02c'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:30:40.197044 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b512c576-63b5-46e5-9dff-571fa3754c7c" -d '{"events": [{"name": "network-changed", "server_uuid": "4f8b0b89-3e7d-4d91-b089-84b81f556a6b", "tag": "689cc7a5-aee5-4e14-b7ee-55f33822a02c"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:30:40.197626 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:40.224039 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-562023a7-9c84-4096-9d2c-63d231dce73c service neutron] Pushing event updated for resources: {'Port': ['ID=689cc7a5-aee5-4e14-b7ee-55f33822a02c,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:40.234063 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:30:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b698963c-60f5-46c3-9423-49bab6fe3f6a x-openstack-request-id: req-b698963c-60f5-46c3-9423-49bab6fe3f6a {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:30:40.234362 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4f8b0b89-3e7d-4d91-b089-84b81f556a6b", "tag": "689cc7a5-aee5-4e14-b7ee-55f33822a02c", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:30:40.234625 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-b698963c-60f5-46c3-9423-49bab6fe3f6a {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:30:40.235025 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'tag': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'status': 'completed', 'code': 200} Nov 18 18:30:40.319039 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b512c576-63b5-46e5-9dff-571fa3754c7c req-221578ac-9a77-4ff1-bbdb-82c1c617c2cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:40.320588 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b512c576-63b5-46e5-9dff-571fa3754c7c req-221578ac-9a77-4ff1-bbdb-82c1c617c2cd service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 1096 time: 0.0435395 Nov 18 18:30:40.492935 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b512c576-63b5-46e5-9dff-571fa3754c7c req-938c1d1a-9285-4328-806a-6603759e3ff5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:40.494404 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b512c576-63b5-46e5-9dff-571fa3754c7c req-938c1d1a-9285-4328-806a-6603759e3ff5 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=d08a29a317934e72a71b69340d23cd0b&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1636345 Nov 18 18:30:40.662491 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b512c576-63b5-46e5-9dff-571fa3754c7c req-bce52bce-4dd5-4d30-99d4-e91eeea319c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:40.664458 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b512c576-63b5-46e5-9dff-571fa3754c7c req-bce52bce-4dd5-4d30-99d4-e91eeea319c3 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1632173 Nov 18 18:30:40.755494 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-e359182f-b280-4d2d-a1ab-5086dee976f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:40.759983 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-e359182f-b280-4d2d-a1ab-5086dee976f8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 1096 time: 0.0420964 Nov 18 18:30:40.801733 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-99366a41-5a67-45bb-81bd-01f5232af258 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=689cc7a5-aee5-4e14-b7ee-55f33822a02c HTTP/1.1" status: 200 len: 217 time: 0.0360615 Nov 18 18:30:40.856176 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-d8cd004e-75e3-4c73-9985-a36153a4223d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:40.857696 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-d8cd004e-75e3-4c73-9985-a36153a4223d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0485721 Nov 18 18:30:40.903576 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-42e566f3-7db5-4b8c-ba3c-f96ed5ca8290 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:40.905034 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-42e566f3-7db5-4b8c-ba3c-f96ed5ca8290 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0396235 Nov 18 18:30:40.992476 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-a3d87f01-faf1-40c8-be09-3dad48ad5dcf service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797925 Nov 18 18:30:41.098447 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9644b895-1bd0-4bff-b17b-9c263fa30907 req-80c71619-5d80-497b-9746-3006753cf4cb tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:41.099952 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9644b895-1bd0-4bff-b17b-9c263fa30907 req-80c71619-5d80-497b-9746-3006753cf4cb tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 943 time: 0.1015749 Nov 18 18:30:41.134218 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-58969f3c-98a2-4132-87a5-da77ea14a7dd req-58b98503-d27e-43bc-acbf-439a42f9cf53 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1340950 Nov 18 18:30:41.161071 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9644b895-1bd0-4bff-b17b-9c263fa30907 req-7fe81ffc-77b5-48c4-8441-e153387d4be9 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0543237 Nov 18 18:30:42.280512 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24a27ef6-9e16-4793-8e1a-f98ae1b36390 req-9ac9aa1d-7b85-4179-a970-172dcbec202b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:42.286309 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-24a27ef6-9e16-4793-8e1a-f98ae1b36390 req-9ac9aa1d-7b85-4179-a970-172dcbec202b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 943 time: 0.0580742 Nov 18 18:30:42.334545 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-24a27ef6-9e16-4793-8e1a-f98ae1b36390 req-47234fea-ed19-4bf0-a61a-b090871db91f tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423741 Nov 18 18:30:43.444201 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be1a52f1-3614-46b2-9ad4-1f5ef9435c56 req-cdf4710a-9829-46e5-a005-b1b12d9fe849 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:43.445661 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-be1a52f1-3614-46b2-9ad4-1f5ef9435c56 req-cdf4710a-9829-46e5-a005-b1b12d9fe849 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 943 time: 0.0468228 Nov 18 18:30:43.493401 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-be1a52f1-3614-46b2-9ad4-1f5ef9435c56 req-304f761a-fa4e-4b98-8e92-cf915d79f9ee tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414162 Nov 18 18:30:44.607342 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e1be55d-667f-451c-813a-30ca62d4cf76 req-a460aad3-4ee3-42c1-83eb-bf229153147a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:44.608828 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4e1be55d-667f-451c-813a-30ca62d4cf76 req-a460aad3-4ee3-42c1-83eb-bf229153147a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 943 time: 0.0497622 Nov 18 18:30:44.656401 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4e1be55d-667f-451c-813a-30ca62d4cf76 req-5469b295-157e-454c-9c37-9f51b926d82f tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416586 Nov 18 18:30:45.770503 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ebb3a1-7f6e-4c2f-8633-d22b4a3134c5 req-7260a0e4-8a62-4c7c-a6e2-11647f92c270 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:45.772051 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88ebb3a1-7f6e-4c2f-8633-d22b4a3134c5 req-7260a0e4-8a62-4c7c-a6e2-11647f92c270 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 943 time: 0.0486031 Nov 18 18:30:45.820993 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88ebb3a1-7f6e-4c2f-8633-d22b4a3134c5 req-1b171042-762f-491b-beb3-d1f062c75c1b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424993 Nov 18 18:30:46.932750 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccbdf9c7-41f5-4eb7-a07f-37d5314088b2 req-ef4b402d-41e8-4a04-a7b0-2e81429e9e3a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:46.934195 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ccbdf9c7-41f5-4eb7-a07f-37d5314088b2 req-ef4b402d-41e8-4a04-a7b0-2e81429e9e3a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 943 time: 0.0470786 Nov 18 18:30:46.984329 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-ccbdf9c7-41f5-4eb7-a07f-37d5314088b2 req-795730c0-deee-401b-af48-c98388793c4b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442228 Nov 18 18:30:48.095738 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2033c23-6cd0-4fe1-a8b4-93e260b340d1 req-95ec54e4-94e5-4810-975a-4960e7e6228e tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:48.097282 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e2033c23-6cd0-4fe1-a8b4-93e260b340d1 req-95ec54e4-94e5-4810-975a-4960e7e6228e tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 943 time: 0.0473907 Nov 18 18:30:48.144456 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e2033c23-6cd0-4fe1-a8b4-93e260b340d1 req-42ac6f55-be5c-43c1-b721-eb0affead17e tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412478 Nov 18 18:30:49.255605 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcbf1f20-86af-4150-b24f-2689a9c8c343 req-a22cc778-1255-4a7a-bae6-efe39460a14e tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:49.257095 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fcbf1f20-86af-4150-b24f-2689a9c8c343 req-a22cc778-1255-4a7a-bae6-efe39460a14e tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 943 time: 0.0478106 Nov 18 18:30:49.304451 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fcbf1f20-86af-4150-b24f-2689a9c8c343 req-afce344c-f158-48d8-98e0-b8bc7b14fcd0 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413983 Nov 18 18:30:50.284403 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 689cc7a5-aee5-4e14-b7ee-55f33822a02c details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:30:50.375587 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 689cc7a5-aee5-4e14-b7ee-55f33822a02c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=689cc7a5-aee5-4e14-b7ee-55f33822a02c,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:30:50.387580 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'port_id': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'mac_address': 'fa:16:3e:58:89:be', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1326, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:30:50.417520 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec8d128-0c66-4b63-89ed-a97e62c3b987 req-7ef1b168-c8bf-4c91-8b29-416c4b1d6da1 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:50.418980 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6ec8d128-0c66-4b63-89ed-a97e62c3b987 req-7ef1b168-c8bf-4c91-8b29-416c4b1d6da1 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 943 time: 0.0504169 Nov 18 18:30:50.422640 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:50.439128 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 689cc7a5-aee5-4e14-b7ee-55f33822a02c {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:30:50.459098 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 689cc7a5-aee5-4e14-b7ee-55f33822a02c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=689cc7a5-aee5-4e14-b7ee-55f33822a02c,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:30:50.463125 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:50.469784 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6ec8d128-0c66-4b63-89ed-a97e62c3b987 req-56e5490c-5709-4d41-8f3f-f0cc62720a44 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449724 Nov 18 18:30:50.509489 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=689cc7a5-aee5-4e14-b7ee-55f33822a02c,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:50.516549 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:50.516898 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:50.517263 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:50.517578 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:50.517906 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:50.518232 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:50.518558 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:50.518882 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:50.519207 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:50.519528 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:50.519876 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:50.520224 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:50.678583 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['689cc7a5-aee5-4e14-b7ee-55f33822a02c'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:30:50.856067 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46586) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:30:50.957220 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-69caf7ab-f52f-4460-908c-710d8e5052a3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:51.028530 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-69caf7ab-f52f-4460-908c-710d8e5052a3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:51.031869 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-69caf7ab-f52f-4460-908c-710d8e5052a3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:51.068766 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-69caf7ab-f52f-4460-908c-710d8e5052a3 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6a0b27d02d9f4eda9a86edf156e1f586&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2116559 Nov 18 18:30:51.069971 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69caf7ab-f52f-4460-908c-710d8e5052a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3b093d5-8acb-4b6c-ba66-1c5a7ace1ac6,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:51.071365 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46590) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:30:51.119576 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:51.139510 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:51.176699 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:51.187946 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:51.190530 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:51.191704 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c3b093d5-8acb-4b6c-ba66-1c5a7ace1ac6 HTTP/1.1" status: 204 len: 168 time: 0.1187637 Nov 18 18:30:51.199966 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3b093d5-8acb-4b6c-ba66-1c5a7ace1ac6,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:51.206896 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:51.207254 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:51.207598 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:51.207976 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:51.208299 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:51.208634 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:51.208966 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:51.209301 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:51.209631 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:51.209955 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:51.210283 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:51.210604 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79a7a136-a7db-4601-92db-c670c4cf207b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:30:51.582047 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbfdc8fe-74b0-4af8-864e-6d35b23e7287 req-60270932-2743-4fb4-ade5-2088e563d21b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:51.583510 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fbfdc8fe-74b0-4af8-864e-6d35b23e7287 req-60270932-2743-4fb4-ade5-2088e563d21b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 944 time: 0.0477295 Nov 18 18:30:51.633858 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fbfdc8fe-74b0-4af8-864e-6d35b23e7287 req-d89bedbc-ef2b-4349-943f-88f943beb935 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442116 Nov 18 18:30:52.287907 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 689cc7a5-aee5-4e14-b7ee-55f33822a02c up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:30:52.335934 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port 689cc7a5-aee5-4e14-b7ee-55f33822a02c completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:30:52.340444 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 689cc7a5-aee5-4e14-b7ee-55f33822a02c triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:30:52.340808 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:52.416548 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:52.437299 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '689cc7a5-aee5-4e14-b7ee-55f33822a02c'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:30:52.439520 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-926f5e29-9495-4856-95f5-7a8fbc6bcc16" -d '{"events": [{"server_uuid": "4f8b0b89-3e7d-4d91-b089-84b81f556a6b", "name": "network-vif-plugged", "status": "completed", "tag": "689cc7a5-aee5-4e14-b7ee-55f33822a02c"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:30:52.452726 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 689cc7a5-aee5-4e14-b7ee-55f33822a02c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=689cc7a5-aee5-4e14-b7ee-55f33822a02c,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:30:52.456684 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:52.482609 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:30:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-17d4a73f-591a-4954-a66d-86104193a1f3 x-openstack-request-id: req-17d4a73f-591a-4954-a66d-86104193a1f3 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:30:52.483013 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4f8b0b89-3e7d-4d91-b089-84b81f556a6b", "name": "network-vif-plugged", "status": "completed", "tag": "689cc7a5-aee5-4e14-b7ee-55f33822a02c", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:30:52.483268 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-17d4a73f-591a-4954-a66d-86104193a1f3 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:30:52.483656 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'code': 200} Nov 18 18:30:52.508505 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=689cc7a5-aee5-4e14-b7ee-55f33822a02c,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:52.686414 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f21ad4e-0b0e-4fdd-b209-5c93d0a034bd req-c9ea67d4-a41a-4bde-ae70-467a95b6fbf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:52.688029 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6f21ad4e-0b0e-4fdd-b209-5c93d0a034bd req-c9ea67d4-a41a-4bde-ae70-467a95b6fbf5 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 1098 time: 0.0411336 Nov 18 18:30:52.767575 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6f21ad4e-0b0e-4fdd-b209-5c93d0a034bd req-60ee118d-8e1d-466b-8d1c-b020b8f3427d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0722897 Nov 18 18:30:52.780115 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c060ed-bdb7-4ced-9cb3-7d130c8a33f8 req-e4f1c12f-eafe-4a76-adf4-76ddbb1f1ba2 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:52.781525 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-16c060ed-bdb7-4ced-9cb3-7d130c8a33f8 req-e4f1c12f-eafe-4a76-adf4-76ddbb1f1ba2 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 945 time: 0.0789094 Nov 18 18:30:52.828579 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-16c060ed-bdb7-4ced-9cb3-7d130c8a33f8 req-7568ad56-e5f7-478f-87bf-c16bb3ff8e59 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411599 Nov 18 18:30:53.946150 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8375bd6-e6d8-4dde-8d7f-33e073e33d87 req-70fa0390-8ee4-4122-b42b-67bf2b82379c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:53.947609 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e8375bd6-e6d8-4dde-8d7f-33e073e33d87 req-70fa0390-8ee4-4122-b42b-67bf2b82379c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 945 time: 0.0518987 Nov 18 18:30:53.996024 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e8375bd6-e6d8-4dde-8d7f-33e073e33d87 req-0d98f400-dfbd-432b-bd9d-d757212cdb83 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426235 Nov 18 18:30:54.105661 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6936d079-a762-47b7-ae93-727e14755a4d req-32ff9331-8c67-4fd2-ae34-5a9847823433 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:54.107116 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6936d079-a762-47b7-ae93-727e14755a4d req-32ff9331-8c67-4fd2-ae34-5a9847823433 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 945 time: 0.0471699 Nov 18 18:30:54.154259 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6936d079-a762-47b7-ae93-727e14755a4d req-c4af5829-6267-40c8-860b-d9b5f8104faa tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413146 Nov 18 18:30:54.176065 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46604) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:30:54.217129 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdf05038-0545-4f9b-9c5f-5b75e96f827b tempest-TestVolumeBootPattern-190622742 tempest-TestVolumeBootPattern-190622742-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:54.218601 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-fdf05038-0545-4f9b-9c5f-5b75e96f827b tempest-TestVolumeBootPattern-190622742 tempest-TestVolumeBootPattern-190622742-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 1093 time: 0.0415926 Nov 18 18:30:54.221307 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46606) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:30:54.225398 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'floatingip': {'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'port_id': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address': '172.20.0.6'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:30:54.247258 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:54.338664 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:54.438968 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Allocated IP 172.27.1.61 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/4c5d883b-ed42-4adf-8dda-1473beaf42d7) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:30:54.533423 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:54.565364 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:54.605294 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:30:54.608064 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:30:54.611475 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:30:54.633963 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'Port': ['ID=4c5d883b-ed42-4adf-8dda-1473beaf42d7,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:54.959717 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:55.025069 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:55.168798 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:55.173084 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:55.238498 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'Port': ['ID=4c5d883b-ed42-4adf-8dda-1473beaf42d7,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:30:55.248425 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:55.342894 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Floating IP 989d6752-bf5c-4f42-b954-2aa48fb217d4 associated. External IP: 172.27.1.61, port: 689cc7a5-aee5-4e14-b7ee-55f33822a02c. Nov 18 18:30:55.540273 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Router ae4f264c-d828-44a7-ab29-e11545372d21 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:30:55.642336 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:30:55.653556 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48c80c27-1fb4-4907-8959-8b1b94c82c49 None None] Sync routers for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:30:55.660121 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:30:55.667422 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48c80c27-1fb4-4907-8959-8b1b94c82c49 None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:30:55.668214 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-48c80c27-1fb4-4907-8959-8b1b94c82c49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:30:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:30:55.686357 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-324731d2-cb83-47b2-acd3-04f02e7daf6b tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.4640779 Nov 18 18:30:55.686916 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'tag': '689cc7a5-aee5-4e14-b7ee-55f33822a02c'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:30:55.689203 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d63c01e-324a-4d93-9f4d-baec22c9c9ce" -d '{"events": [{"name": "network-changed", "server_uuid": "4f8b0b89-3e7d-4d91-b089-84b81f556a6b", "tag": "689cc7a5-aee5-4e14-b7ee-55f33822a02c"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:30:55.726747 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:30:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-93325fb9-1260-46a5-91f8-f6fe85509264 x-openstack-request-id: req-93325fb9-1260-46a5-91f8-f6fe85509264 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:30:55.727045 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4f8b0b89-3e7d-4d91-b089-84b81f556a6b", "tag": "689cc7a5-aee5-4e14-b7ee-55f33822a02c", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:30:55.727570 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-93325fb9-1260-46a5-91f8-f6fe85509264 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:30:55.727999 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'tag': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'status': 'completed', 'code': 200} Nov 18 18:30:55.775919 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-48c80c27-1fb4-4907-8959-8b1b94c82c49 None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:30:55.789266 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d63c01e-324a-4d93-9f4d-baec22c9c9ce req-98c9a9c6-fee0-410d-8771-552671ec81f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:55.790889 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0d63c01e-324a-4d93-9f4d-baec22c9c9ce req-98c9a9c6-fee0-410d-8771-552671ec81f7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 1098 time: 0.0415566 Nov 18 18:30:55.883735 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d63c01e-324a-4d93-9f4d-baec22c9c9ce req-ce4e6475-9dad-4a94-80b1-1f94da4c2580 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:55.885805 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0d63c01e-324a-4d93-9f4d-baec22c9c9ce req-ce4e6475-9dad-4a94-80b1-1f94da4c2580 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 913 time: 0.0861459 Nov 18 18:30:55.949680 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0d63c01e-324a-4d93-9f4d-baec22c9c9ce req-7793a528-b5aa-4da0-b6d9-b4c8af023d97 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=689cc7a5-aee5-4e14-b7ee-55f33822a02c HTTP/1.1" status: 200 len: 998 time: 0.0565381 Nov 18 18:30:55.996481 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-48c80c27-1fb4-4907-8959-8b1b94c82c49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '989d6752-bf5c-4f42-b954-2aa48fb217d4', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.61', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:58:89:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:30:54Z', 'updated_at': '2021-11-18T18:30:54Z', 'revision_number': 0, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:30:56.000956 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d63c01e-324a-4d93-9f4d-baec22c9c9ce req-5a6cd3d5-7a7d-49ff-b88a-849a0c553c54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:56.002422 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0d63c01e-324a-4d93-9f4d-baec22c9c9ce req-5a6cd3d5-7a7d-49ff-b88a-849a0c553c54 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0451639 Nov 18 18:30:56.023242 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48c80c27-1fb4-4907-8959-8b1b94c82c49 None None] Checking router: ae4f264c-d828-44a7-ab29-e11545372d21 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:30:56.032218 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48c80c27-1fb4-4907-8959-8b1b94c82c49 None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:30:56.032825 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-48c80c27-1fb4-4907-8959-8b1b94c82c49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:30:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:30:56.048038 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d63c01e-324a-4d93-9f4d-baec22c9c9ce req-7e62f874-d37f-46c1-9df8-e76951a0ac7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:30:56.049439 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0d63c01e-324a-4d93-9f4d-baec22c9c9ce req-7e62f874-d37f-46c1-9df8-e76951a0ac7b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0388112 Nov 18 18:30:56.137401 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-48c80c27-1fb4-4907-8959-8b1b94c82c49 None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:30:56.141138 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0d63c01e-324a-4d93-9f4d-baec22c9c9ce req-d5f4a68c-44a1-4fd3-a7af-5d4a835556a7 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835340 Nov 18 18:30:56.372250 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-48c80c27-1fb4-4907-8959-8b1b94c82c49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '989d6752-bf5c-4f42-b954-2aa48fb217d4', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.61', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:58:89:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:30:54Z', 'updated_at': '2021-11-18T18:30:54Z', 'revision_number': 0, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:30:56.399618 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48c80c27-1fb4-4907-8959-8b1b94c82c49 None None] The sync data for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi is: [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '989d6752-bf5c-4f42-b954-2aa48fb217d4', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.61', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:58:89:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:30:54Z', 'updated_at': '2021-11-18T18:30:54Z', 'revision_number': 0, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:30:56.473078 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0d63c01e-324a-4d93-9f4d-baec22c9c9ce req-ea7a75b7-82ba-47da-a3cb-adad86c8c745 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3230853 Nov 18 18:30:56.579957 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0882a6d1-bc1e-4d8b-a33f-af426eb83995 None None] New status for floating IP 989d6752-bf5c-4f42-b954-2aa48fb217d4: ACTIVE {{(pid=102691) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:31:03.999788 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-c9f0061c-3085-4c87-a38d-1f61807ed35c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:31:06.445499 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-52465d3f-add5-443b-ba13-8e9b71a5b8f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:31:07.736436 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:31:09.083573 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:31:10.200120 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:31:14.477389 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:31:21.203498 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:31:23.495615 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aed504ae-87b0-469f-89f0-e8c4192b4a9c req-f08b48e4-93f2-4007-a672-a1804798be3d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0382144 Nov 18 18:31:23.578003 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed504ae-87b0-469f-89f0-e8c4192b4a9c req-8cf28a1a-d570-4a44-8009-65e08a284509 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:31:23.579447 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aed504ae-87b0-469f-89f0-e8c4192b4a9c req-8cf28a1a-d570-4a44-8009-65e08a284509 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 1098 time: 0.0408745 Nov 18 18:31:23.679332 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed504ae-87b0-469f-89f0-e8c4192b4a9c req-858ce932-75b3-4b94-b2f9-eaebaf802edf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:31:23.680833 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aed504ae-87b0-469f-89f0-e8c4192b4a9c req-858ce932-75b3-4b94-b2f9-eaebaf802edf service neutron] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 913 time: 0.0820639 Nov 18 18:31:23.747714 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aed504ae-87b0-469f-89f0-e8c4192b4a9c req-65de6248-f179-4fe5-ac0e-fcc447015347 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=689cc7a5-aee5-4e14-b7ee-55f33822a02c HTTP/1.1" status: 200 len: 1000 time: 0.0592980 Nov 18 18:31:23.795063 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed504ae-87b0-469f-89f0-e8c4192b4a9c req-491cda97-9ddf-47f2-a9f8-bf196cc1dc7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:31:23.796526 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aed504ae-87b0-469f-89f0-e8c4192b4a9c req-491cda97-9ddf-47f2-a9f8-bf196cc1dc7c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0420868 Nov 18 18:31:23.841734 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed504ae-87b0-469f-89f0-e8c4192b4a9c req-106a6c71-45b0-4d35-a79f-5755a4ee6b1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:31:23.843188 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aed504ae-87b0-469f-89f0-e8c4192b4a9c req-106a6c71-45b0-4d35-a79f-5755a4ee6b1d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0384822 Nov 18 18:31:23.934781 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aed504ae-87b0-469f-89f0-e8c4192b4a9c req-1c2913a5-5042-423d-987d-23324e6529ac service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819938 Nov 18 18:31:24.024666 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-aed504ae-87b0-469f-89f0-e8c4192b4a9c req-d81ecd89-cc1b-4627-9ac2-b68f78eda137 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822849 Nov 18 18:31:34.000269 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-438b50e2-7a30-4ebe-b49e-032f5d6452cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:31:36.446454 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-35b3819e-1832-4b9f-98a9-4c3f18eecfc5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:31:37.742651 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:31:39.084910 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:31:40.201461 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:31:51.216191 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:31:51.475675 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:32:04.001066 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-dd1c24ef-7c60-405c-8073-bb68e61b27ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:06.446921 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-85b9f957-7094-4f1d-b14a-66a816925873 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:07.741932 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:09.086315 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:10.202024 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:21.231712 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:26.278056 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a094063b-9233-42ef-b3b7-3638533a937d req-a8766f25-0188-40eb-b819-71ef3a85a899 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1251361 Nov 18 18:32:26.365448 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a094063b-9233-42ef-b3b7-3638533a937d req-1999f695-21b2-4149-b7f7-26d0722d6b9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:26.366927 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a094063b-9233-42ef-b3b7-3638533a937d req-1999f695-21b2-4149-b7f7-26d0722d6b9a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 1098 time: 0.0415518 Nov 18 18:32:26.478041 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a094063b-9233-42ef-b3b7-3638533a937d req-b050b0e4-0f31-47d5-b1d9-0ab01a136135 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:26.479422 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a094063b-9233-42ef-b3b7-3638533a937d req-b050b0e4-0f31-47d5-b1d9-0ab01a136135 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 913 time: 0.0866413 Nov 18 18:32:26.541883 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a094063b-9233-42ef-b3b7-3638533a937d req-976ad60c-c125-4382-80af-3f18dbd0047b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=689cc7a5-aee5-4e14-b7ee-55f33822a02c HTTP/1.1" status: 200 len: 1000 time: 0.0550699 Nov 18 18:32:26.589511 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a094063b-9233-42ef-b3b7-3638533a937d req-31bb5dd1-4ead-47f0-9969-44f6fef6a4b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:26.590901 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a094063b-9233-42ef-b3b7-3638533a937d req-31bb5dd1-4ead-47f0-9969-44f6fef6a4b2 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0416126 Nov 18 18:32:26.638654 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a094063b-9233-42ef-b3b7-3638533a937d req-123ef06a-ff3f-4f4b-810b-06caa06c1db6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:26.640129 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a094063b-9233-42ef-b3b7-3638533a937d req-123ef06a-ff3f-4f4b-810b-06caa06c1db6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0416160 Nov 18 18:32:26.651956 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [req-a094063b-9233-42ef-b3b7-3638533a937d req-7cf31f3e-df6a-499b-99d0-6d74144b05f5 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:32:26.652882 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a094063b-9233-42ef-b3b7-3638533a937d req-7cf31f3e-df6a-499b-99d0-6d74144b05f5 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0047460 Nov 18 18:32:26.740575 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a094063b-9233-42ef-b3b7-3638533a937d req-9f28e257-e9fd-40e9-99a8-19a42addb0d1 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0801601 Nov 18 18:32:26.832731 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-a094063b-9233-42ef-b3b7-3638533a937d req-cb1e7465-b5c3-47ba-8391-1e603452edda service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845313 Nov 18 18:32:28.475709 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:32:32.136768 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-bb3fbd71-4b37-4552-9ae2-eec28aa2cba0 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1203552063&fields=id&tenant_id=d08a29a317934e72a71b69340d23cd0b HTTP/1.1" status: 200 len: 267 time: 0.0434222 Nov 18 18:32:32.242424 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88500114-3cc7-45fc-b751-2743c65003c7 req-dad7d1da-fffb-4687-92a4-9184a4f03623 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:32.243756 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-dad7d1da-fffb-4687-92a4-9184a4f03623 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 811 time: 0.0999949 Nov 18 18:32:32.258667 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-7ca5fcbc-0e04-4b90-b9d5-681f72bf1807 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/quotas/d08a29a317934e72a71b69340d23cd0b HTTP/1.1" status: 200 len: 375 time: 0.0092003 Nov 18 18:32:32.308913 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-d6569e13-e5f8-4912-bc54-ffd4ac230894 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0451024 Nov 18 18:32:32.369395 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-49e0c976-f7a5-407c-939c-02210649906b service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=102689) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 18:32:32.370487 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-49e0c976-f7a5-407c-939c-02210649906b service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0505214 Nov 18 18:32:32.459181 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-88ffa143-fe68-4ec0-b5f9-11bd4472efa7 service neutron] 10.222.0.82 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819523 Nov 18 18:32:32.548793 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-5dbb7e92-036d-460e-b705-e7538cbb62bd service neutron] 10.222.0.82 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835464 Nov 18 18:32:32.875281 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-3ec482d7-2b20-4aca-b319-31816774c749 req-84611f81-ad27-4c96-948b-945493f10469 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 210 time: 0.0747044 Nov 18 18:32:33.859339 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88500114-3cc7-45fc-b751-2743c65003c7 req-6bd495f4-02e4-4022-982c-c4cac42b1cbc tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:33.860825 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-6bd495f4-02e4-4022-982c-c4cac42b1cbc tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 811 time: 0.1089604 Nov 18 18:32:33.927392 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-094cba9f-9ca1-43c8-925e-d6f7bfea78e1 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d08a29a317934e72a71b69340d23cd0b HTTP/1.1" status: 200 len: 380 time: 0.0553296 Nov 18 18:32:33.937718 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-88500114-3cc7-45fc-b751-2743c65003c7 req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'port': {'device_id': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'admin_state_up': True, 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'security_groups': ['dd44e10b-bbd9-463d-98f3-ddfd17eace36']}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:32:33.981081 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-46168b3a-9c67-4f56-8c2c-933e79276191 req-3e60c3ff-f738-4474-aacf-579cfa19e02d tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 210 time: 0.0379605 Nov 18 18:32:34.005447 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-43aee295-cd29-4950-83c1-90e800bf10f4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:34.070372 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-88500114-3cc7-45fc-b751-2743c65003c7 req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Made reservation on behalf of d08a29a317934e72a71b69340d23cd0b for: {'port': 1} {{(pid=102689) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 18:32:34.073803 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-88500114-3cc7-45fc-b751-2743c65003c7 req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:34.198064 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [req-88500114-3cc7-45fc-b751-2743c65003c7 req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Allocated IP 172.20.0.7 (1cf7f705-4c7c-4525-bcfb-71db85eb96a0/3cd0c89d-cb17-425f-b060-6f88dbc2e31b/2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:32:34.341322 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-88500114-3cc7-45fc-b751-2743c65003c7 req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:34.374759 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-88500114-3cc7-45fc-b751-2743c65003c7 req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:34.415433 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-88500114-3cc7-45fc-b751-2743c65003c7 req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:32:34.418450 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [req-88500114-3cc7-45fc-b751-2743c65003c7 req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:32:34.421986 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-88500114-3cc7-45fc-b751-2743c65003c7 req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:32:34.430463 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'Port': ['ID=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:32:34.462046 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:34.462492 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:34.462989 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:34.463391 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:34.463759 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:34.464259 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:34.464552 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:34.465016 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:34.465403 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:34.465737 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:34.466070 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:34.466402 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:34.496333 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88500114-3cc7-45fc-b751-2743c65003c7 req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:34.497130 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-88500114-3cc7-45fc-b751-2743c65003c7 req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:34.514813 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-4f757632-8ac2-4738-b86a-6d0a69af399a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5808053 Nov 18 18:32:34.527378 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Request body: {'port': {'device_id': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78776'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:32:34.582929 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:34.668584 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-ab7ce13c-8f26-4fbb-bcf6-b58cad084d9a None None] Provisioning complete for port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 triggered by entity DHCP. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:32:34.668864 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-ab7ce13c-8f26-4fbb-bcf6-b58cad084d9a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:34.701727 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-ab7ce13c-8f26-4fbb-bcf6-b58cad084d9a None None] Port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 cannot update to ACTIVE because it is not bound. {{(pid=102690) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 18:32:34.837138 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 {{(pid=102689) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:32:34.844814 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:34.856460 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.provisioning_blocks [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Transition to ACTIVE for port object 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 will not be triggered until provisioned by entity L2. {{(pid=102689) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 18:32:34.860581 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:34.909357 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Pushing event updated for resources: {'Port': ['ID=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:32:34.977674 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Attempting to bind port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 on host hv-cinder-78776 for vnic_type normal with profile {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 18:32:34.978013 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Attempting to bind port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 by drivers openvswitch,hyperv on host hv-cinder-78776 at level 0 using segments [{'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 18:32:34.978354 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Attempting to bind port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 on network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:32:34.983483 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 on network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78776 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 18:32:34.983952 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Attempting to bind port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 on network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 18:32:34.989135 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Checking agent: {'id': '68b4c867-a33d-4f9a-adea-aebec09e0c50', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78776', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'started_at': datetime.datetime(2021, 11, 18, 18, 19, 21), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 18, 32, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 18:32:34.989475 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Checking segment: {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102689) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 18:32:34.989863 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Bound using segment: {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'} {{(pid=102689) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 18:32:34.990297 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.managers [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Bound port: 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34, host: hv-cinder-78776, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '50c99b05-6341-4b99-80f2-ffdf7a114b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0'}}] {{(pid=102689) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 18:32:34.990653 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:35.065700 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] For port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34, host hv-cinder-78776, cleared binding levels {{(pid=102689) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 18:32:35.097940 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] For port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34, host hv-cinder-78776, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102689) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 18:32:35.104446 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:35.144164 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:35.144770 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:35.146276 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] 10.222.0.31 "PUT /v2.0/ports/2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 HTTP/1.1" status: 200 len: 1093 time: 0.6231136 Nov 18 18:32:35.148178 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'tag': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:32:35.150398 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a3bd175-98eb-4c00-a3d3-fd0c7d125ab3" -d '{"events": [{"name": "network-changed", "server_uuid": "2d0d5242-72ce-4819-8cc5-d87176d5fe20", "tag": "2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:32:35.165238 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ab09e0-931a-4f7f-bb8b-fc38e9180d37 req-9dd02e74-13a4-4df4-88f7-254aae191e24 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:35.166784 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e5ab09e0-931a-4f7f-bb8b-fc38e9180d37 req-9dd02e74-13a4-4df4-88f7-254aae191e24 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 943 time: 0.1025186 Nov 18 18:32:35.189170 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b26ac1-e8b2-4f64-a1b4-f7e195011f9f service neutron] Pushing event updated for resources: {'Port': ['ID=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34,revision_number=3']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:32:35.260415 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e5ab09e0-931a-4f7f-bb8b-fc38e9180d37 req-87e24f6f-524e-4bee-a95a-5c0edb5a92c3 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0826762 Nov 18 18:32:35.272283 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88500114-3cc7-45fc-b751-2743c65003c7 req-96e1405f-5018-4411-b028-bb88f8b8380e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:35.273779 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-96e1405f-5018-4411-b028-bb88f8b8380e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 1096 time: 0.0694447 Nov 18 18:32:35.275309 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:32:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94e8d4d4-d7cb-41f8-847f-4e3b22a69f00 x-openstack-request-id: req-94e8d4d4-d7cb-41f8-847f-4e3b22a69f00 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:32:35.275518 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2d0d5242-72ce-4819-8cc5-d87176d5fe20", "tag": "2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:32:35.275771 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-94e8d4d4-d7cb-41f8-847f-4e3b22a69f00 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:32:35.276174 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'tag': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34', 'status': 'completed', 'code': 200} Nov 18 18:32:35.318716 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-9288eb35-1cf8-4ee6-9c59-9d4038dd4439 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 HTTP/1.1" status: 200 len: 217 time: 0.0342562 Nov 18 18:32:35.368057 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88500114-3cc7-45fc-b751-2743c65003c7 req-3b5a4b07-d919-45ec-93a4-86c96696fd0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:35.369455 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-3b5a4b07-d919-45ec-93a4-86c96696fd0c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0430853 Nov 18 18:32:35.416683 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88500114-3cc7-45fc-b751-2743c65003c7 req-393d1538-8e33-4d5d-bfa8-52f0fedbd26c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:35.418048 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-393d1538-8e33-4d5d-bfa8-52f0fedbd26c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0411277 Nov 18 18:32:35.505446 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-2e9ad058-ac5f-421b-8f1d-c9914cad22da service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792148 Nov 18 18:32:35.596032 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-88500114-3cc7-45fc-b751-2743c65003c7 req-3387e0a3-4a04-46d9-8d68-6896cff79d48 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822973 Nov 18 18:32:35.680054 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3bd175-98eb-4c00-a3d3-fd0c7d125ab3 req-102bbd17-8889-41a6-b237-20d2f304653c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:35.681527 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4a3bd175-98eb-4c00-a3d3-fd0c7d125ab3 req-102bbd17-8889-41a6-b237-20d2f304653c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 1096 time: 0.0403461 Nov 18 18:32:35.768983 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3bd175-98eb-4c00-a3d3-fd0c7d125ab3 req-1cfc968f-c7d6-4c03-b62b-1fe2cfb0eeb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:35.770437 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4a3bd175-98eb-4c00-a3d3-fd0c7d125ab3 req-1cfc968f-c7d6-4c03-b62b-1fe2cfb0eeb6 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 913 time: 0.0808153 Nov 18 18:32:35.815557 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4a3bd175-98eb-4c00-a3d3-fd0c7d125ab3 req-927c4c02-5e79-4c79-9bd6-1970b1cbe633 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 HTTP/1.1" status: 200 len: 217 time: 0.0366106 Nov 18 18:32:35.863905 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3bd175-98eb-4c00-a3d3-fd0c7d125ab3 req-d60aa8af-b10b-4017-8c50-c35bff7ad605 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:35.865337 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4a3bd175-98eb-4c00-a3d3-fd0c7d125ab3 req-d60aa8af-b10b-4017-8c50-c35bff7ad605 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0416772 Nov 18 18:32:35.910369 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3bd175-98eb-4c00-a3d3-fd0c7d125ab3 req-44586b7a-8a1b-45e7-8147-50dfdfa28dca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:35.911804 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4a3bd175-98eb-4c00-a3d3-fd0c7d125ab3 req-44586b7a-8a1b-45e7-8147-50dfdfa28dca service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0378222 Nov 18 18:32:36.003334 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4a3bd175-98eb-4c00-a3d3-fd0c7d125ab3 req-fd195f12-00cf-4dbe-b9c3-564b33b3ff41 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826297 Nov 18 18:32:36.108743 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4a3bd175-98eb-4c00-a3d3-fd0c7d125ab3 req-da3b6b68-801c-4a07-89db-0bdca92c8446 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820541 Nov 18 18:32:36.426279 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89473d35-9b17-41ce-8e41-636e02c04d14 req-4fc3c71a-1f25-4c11-8138-e7771532490f tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:36.427711 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-89473d35-9b17-41ce-8e41-636e02c04d14 req-4fc3c71a-1f25-4c11-8138-e7771532490f tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 943 time: 0.0475557 Nov 18 18:32:36.449089 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-83dcf0df-4b62-4e9a-8a49-a39c60bcfd61 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:36.478551 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-89473d35-9b17-41ce-8e41-636e02c04d14 req-619ccb7b-e9bd-4ef1-b829-bfd1f49dcb19 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447769 Nov 18 18:32:37.591386 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da83113-2f1a-4de2-b7b2-77864d9e763f req-ba076736-f85e-4054-bbc3-a6077d09f175 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:37.592866 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0da83113-2f1a-4de2-b7b2-77864d9e763f req-ba076736-f85e-4054-bbc3-a6077d09f175 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 943 time: 0.0477467 Nov 18 18:32:37.639762 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0da83113-2f1a-4de2-b7b2-77864d9e763f req-55917cc3-9314-44ab-9cd2-63624b111f67 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410774 Nov 18 18:32:37.744505 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:38.753295 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9884d405-854c-4a71-bc07-75e8624895f2 req-21e254db-31e5-46fe-8823-3295152a9797 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:38.754646 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9884d405-854c-4a71-bc07-75e8624895f2 req-21e254db-31e5-46fe-8823-3295152a9797 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 943 time: 0.0499725 Nov 18 18:32:38.802533 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9884d405-854c-4a71-bc07-75e8624895f2 req-f74db90d-6dc3-4e24-bc8b-3bbf074d9c63 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420299 Nov 18 18:32:39.089727 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:39.912485 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e3235ae-dc8d-4c58-b129-b0b97df7cba3 req-b0d247e2-62f9-4aaf-8483-f998568e4269 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:39.913943 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9e3235ae-dc8d-4c58-b129-b0b97df7cba3 req-b0d247e2-62f9-4aaf-8483-f998568e4269 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 943 time: 0.0465934 Nov 18 18:32:39.961028 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-9e3235ae-dc8d-4c58-b129-b0b97df7cba3 req-dfeb8810-531d-46fa-b941-9804506c7447 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412652 Nov 18 18:32:40.203630 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:41.072332 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-245798fa-82ff-4433-b22e-765fa17c0fb6 req-617903f7-6d8b-4ee1-abd1-db218f055524 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:41.073691 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-245798fa-82ff-4433-b22e-765fa17c0fb6 req-617903f7-6d8b-4ee1-abd1-db218f055524 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 943 time: 0.0466218 Nov 18 18:32:41.128297 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-245798fa-82ff-4433-b22e-765fa17c0fb6 req-aaa578fc-4e0e-4071-aba2-8a8f5feaa63c tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487778 Nov 18 18:32:42.237684 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa5ee255-a640-431a-ad5f-967275eb81fa req-de3ef256-261d-4bd2-8b5e-9b41470623b7 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:42.239155 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fa5ee255-a640-431a-ad5f-967275eb81fa req-de3ef256-261d-4bd2-8b5e-9b41470623b7 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 943 time: 0.0471158 Nov 18 18:32:42.287423 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fa5ee255-a640-431a-ad5f-967275eb81fa req-9c419f1e-68fc-402b-9534-6b8b66e708b2 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425136 Nov 18 18:32:43.398795 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d26026-fdfe-4bbc-ac28-c29a45f503fc req-ba9f918f-eb9f-4679-b0e1-19a73dcec863 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:43.400272 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e2d26026-fdfe-4bbc-ac28-c29a45f503fc req-ba9f918f-eb9f-4679-b0e1-19a73dcec863 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 943 time: 0.0462344 Nov 18 18:32:43.446410 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-e2d26026-fdfe-4bbc-ac28-c29a45f503fc req-f4562dd4-ca28-4947-8d02-bdd7e983cde6 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403895 Nov 18 18:32:44.563279 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d599ff57-39c8-480d-9350-5edd0200078b req-9ea621f6-6900-4a86-aca0-1e176aad72b2 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:44.564770 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d599ff57-39c8-480d-9350-5edd0200078b req-9ea621f6-6900-4a86-aca0-1e176aad72b2 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 943 time: 0.0515628 Nov 18 18:32:44.613162 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d599ff57-39c8-480d-9350-5edd0200078b req-b29ae6a6-887b-4466-aa4d-f83d9ad6fdba tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425594 Nov 18 18:32:44.789508 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 details requested by agent hyperv_hv-cinder-78776 with host hv-cinder-78776 {{(pid=102690) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 18:32:44.880233 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:32:44.895458 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Returning: {'device': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'port_id': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34', 'mac_address': 'fa:16:3e:c7:f1:8d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1326, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102690) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 18:32:44.930515 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:44.942495 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 {{(pid=102690) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 18:32:44.961111 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:32:44.964612 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:45.009197 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34,revision_number=4']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:32:45.015806 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:45.016753 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:45.017097 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:45.017428 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:45.017760 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:45.018089 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:45.018413 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:45.018738 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:45.019065 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:45.019383 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:45.019705 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:45.020051 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102690) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:32:45.209349 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] get_ports_and_sgs() called for port_ids ['2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34'] {{(pid=102690) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 18:32:45.721698 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f7f14dc-0ca3-45ba-be8a-e75767655faf req-201247fa-b0a3-46f0-938e-40ff5c0e3fd5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:45.723139 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6f7f14dc-0ca3-45ba-be8a-e75767655faf req-201247fa-b0a3-46f0-938e-40ff5c0e3fd5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 944 time: 0.0469232 Nov 18 18:32:45.770962 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-6f7f14dc-0ca3-45ba-be8a-e75767655faf req-cf999688-a1fd-4888-891c-f82f44981a53 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417161 Nov 18 18:32:46.793218 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 up at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 18:32:46.845780 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning for port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 completed by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 18:32:46.849735 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.provisioning_blocks [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Provisioning complete for port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 triggered by entity L2. {{(pid=102690) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 18:32:46.850102 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-777993'] for port, provisioning_complete {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:46.888534 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d3f8d9-b0af-44e6-8a13-db5c5b86123e req-dfd4a7cd-cbdb-4cfd-8297-fdab6ef19199 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:46.890022 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-28d3f8d9-b0af-44e6-8a13-db5c5b86123e req-dfd4a7cd-cbdb-4cfd-8297-fdab6ef19199 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 944 time: 0.0515187 Nov 18 18:32:46.927128 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:46.939950 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-28d3f8d9-b0af-44e6-8a13-db5c5b86123e req-d8dd6b95-4f77-47de-80ee-c9bdcc3cbe48 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433531 Nov 18 18:32:46.950748 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34'}] {{(pid=102690) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:32:46.953935 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4fb7dcbe4e1ea7cd23dfc316fd23f8f50e8c2aaf3585717f1f025ce4c0ed6dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-300e7266-30c6-4697-8383-145c7aa8a747" -d '{"events": [{"server_uuid": "2d0d5242-72ce-4819-8cc5-d87176d5fe20", "name": "network-vif-plugged", "status": "completed", "tag": "2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34"}]}' {{(pid=102690) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:32:46.967656 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.db [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] For port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102690) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:32:46.971426 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623'] for port, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:47.019998 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Pushing event updated for resources: {'Port': ['ID=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34,revision_number=5']} {{(pid=102690) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:32:47.044817 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:32:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d698ab1b-0bd1-4485-98b3-f91fc7422c49 x-openstack-request-id: req-d698ab1b-0bd1-4485-98b3-f91fc7422c49 {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:32:47.045116 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2d0d5242-72ce-4819-8cc5-d87176d5fe20", "name": "network-vif-plugged", "status": "completed", "tag": "2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34", "code": 200}]} {{(pid=102690) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:32:47.045375 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-d698ab1b-0bd1-4485-98b3-f91fc7422c49 {{(pid=102690) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:32:47.045772 dv-cinder-787764-6-iscsi neutron-server[102690]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34', 'code': 200} Nov 18 18:32:47.270791 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8bf829b-f459-4ef5-815e-78f41f531cff req-31e6d992-8640-489f-9a12-4ddf4773cac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:47.272217 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f8bf829b-f459-4ef5-815e-78f41f531cff req-31e6d992-8640-489f-9a12-4ddf4773cac7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 1098 time: 0.0393634 Nov 18 18:32:47.317570 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-f8bf829b-f459-4ef5-815e-78f41f531cff req-d6c4c720-efcf-4895-b90c-deb71f5a1d26 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378881 Nov 18 18:32:48.053362 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c22361e9-ba60-42e7-aadb-68333484d7a6 req-8a9a67be-36f6-49cd-bdad-7e94a8c05dea tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:48.054718 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c22361e9-ba60-42e7-aadb-68333484d7a6 req-8a9a67be-36f6-49cd-bdad-7e94a8c05dea tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 945 time: 0.0471129 Nov 18 18:32:48.104380 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c22361e9-ba60-42e7-aadb-68333484d7a6 req-aec197bc-9a06-4a1f-8708-50479cab5b67 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436509 Nov 18 18:32:49.216750 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0a5058b-44e6-43a7-ba99-7995b90d55e3 req-0e96e615-e36b-443b-9333-ec20732bcade tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:49.218235 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c0a5058b-44e6-43a7-ba99-7995b90d55e3 req-0e96e615-e36b-443b-9333-ec20732bcade tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 945 time: 0.0475819 Nov 18 18:32:49.266156 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-c0a5058b-44e6-43a7-ba99-7995b90d55e3 req-e82cfdee-6706-4e7e-a128-4a3d1771cd1d tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420635 Nov 18 18:32:49.376910 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b6b705-1859-4141-9d22-be6d78f41cbe req-1bcee630-09e4-406c-abff-cd79b2eb5837 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:49.378365 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d0b6b705-1859-4141-9d22-be6d78f41cbe req-1bcee630-09e4-406c-abff-cd79b2eb5837 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 945 time: 0.0478406 Nov 18 18:32:49.424829 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-d0b6b705-1859-4141-9d22-be6d78f41cbe req-4b47dbb5-116a-4ac8-b6b5-9667b0c17112 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406387 Nov 18 18:32:49.446681 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46756) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:32:49.488067 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f43480e-957b-4877-91c4-e71b96bc78e5 tempest-TestVolumeBootPattern-190622742 tempest-TestVolumeBootPattern-190622742-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:49.489528 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-4f43480e-957b-4877-91c4-e71b96bc78e5 tempest-TestVolumeBootPattern-190622742 tempest-TestVolumeBootPattern-190622742-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 1093 time: 0.0419106 Nov 18 18:32:49.492166 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46758) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:32:49.496242 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.v2.base [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Request body: {'floatingip': {'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'port_id': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address': '172.20.0.7'}} {{(pid=102689) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 18:32:49.517548 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:49.610945 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:49.711514 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.db_base_plugin_common [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Allocated IP 172.27.1.13 (2cab888d-52a8-434c-814e-4f25740decd0/27c45147-26a4-4b40-9fdf-2f6fc0a394bf/f3442c6f-3221-441a-a372-f4da4812c9b4) {{(pid=102689) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 18:32:49.807899 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for port, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:49.839350 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8772714603587', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:49.876893 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Network 2cab888d-52a8-434c-814e-4f25740decd0 is already hosted by enough agents. {{(pid=102689) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 18:32:49.881166 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.base_scheduler [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Resources bound (agent type, host, resource id): {{(pid=102689) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 18:32:49.883687 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Received port after_create {{(pid=102689) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 18:32:49.914777 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'Port': ['ID=f3442c6f-3221-441a-a372-f4da4812c9b4,revision_number=1']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:32:50.228961 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:50.294278 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-664585'] for port, before_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:50.682826 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for port, precommit_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:50.687902 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8772714945823', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8772714603605', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8772714603623', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12723905'] for port, after_update {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:50.753335 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event updated for resources: {'Port': ['ID=f3442c6f-3221-441a-a372-f4da4812c9b4,revision_number=2']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:32:50.761224 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-500401'] for floatingip, after_create {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:50.856938 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Floating IP f802f580-15ed-4784-b023-14325ff52c1c associated. External IP: 172.27.1.13, port: 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34. Nov 18 18:32:51.053667 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Router ae4f264c-d828-44a7-ab29-e11545372d21 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:32:51.155466 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:32:51.166555 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06f02d00-f1eb-45ad-a3c9-379e858b549c None None] Sync routers for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:32:51.173399 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:51.176984 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06f02d00-f1eb-45ad-a3c9-379e858b549c None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:32:51.177670 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-06f02d00-f1eb-45ad-a3c9-379e858b549c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:32:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:32:51.198860 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-6828b9bd-637b-4666-bb99-941516bb9ffe tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.7057235 Nov 18 18:32:51.199540 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'tag': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:32:51.201797 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e0d37c5-c515-4999-b5dc-26af9f19acc6" -d '{"events": [{"name": "network-changed", "server_uuid": "2d0d5242-72ce-4819-8cc5-d87176d5fe20", "tag": "2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:32:51.239948 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:32:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34d9f76a-44dc-4f18-bb20-600ce7fe388c x-openstack-request-id: req-34d9f76a-44dc-4f18-bb20-600ce7fe388c {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:32:51.240576 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2d0d5242-72ce-4819-8cc5-d87176d5fe20", "tag": "2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:32:51.240576 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-34d9f76a-44dc-4f18-bb20-600ce7fe388c {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:32:51.240907 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'tag': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34', 'status': 'completed', 'code': 200} Nov 18 18:32:51.270179 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:32:51.292990 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-06f02d00-f1eb-45ad-a3c9-379e858b549c None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:32:51.307734 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0d37c5-c515-4999-b5dc-26af9f19acc6 req-dc6b3952-1fc0-478a-a83a-1c60d7a1d996 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:51.309186 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e0d37c5-c515-4999-b5dc-26af9f19acc6 req-dc6b3952-1fc0-478a-a83a-1c60d7a1d996 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 1098 time: 0.0405228 Nov 18 18:32:51.403240 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0d37c5-c515-4999-b5dc-26af9f19acc6 req-f68aeb52-097b-45eb-ab78-c87fb4700d09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:51.404736 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e0d37c5-c515-4999-b5dc-26af9f19acc6 req-f68aeb52-097b-45eb-ab78-c87fb4700d09 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 913 time: 0.0858848 Nov 18 18:32:51.476521 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e0d37c5-c515-4999-b5dc-26af9f19acc6 req-d5f0f57f-6d72-4b8a-8bda-ae3b36508e13 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 HTTP/1.1" status: 200 len: 998 time: 0.0598300 Nov 18 18:32:51.512673 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-06f02d00-f1eb-45ad-a3c9-379e858b549c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '989d6752-bf5c-4f42-b954-2aa48fb217d4', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.61', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:58:89:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:30:54Z', 'updated_at': '2021-11-18T18:30:56Z', 'revision_number': 1, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}, {'id': 'f802f580-15ed-4784-b023-14325ff52c1c', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.13', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:c7:f1:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:32:50Z', 'updated_at': '2021-11-18T18:32:50Z', 'revision_number': 0, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:32:51.524915 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0d37c5-c515-4999-b5dc-26af9f19acc6 req-2c6adc42-f5af-4069-8cd0-3f82f501e632 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:51.526389 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e0d37c5-c515-4999-b5dc-26af9f19acc6 req-2c6adc42-f5af-4069-8cd0-3f82f501e632 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0421979 Nov 18 18:32:51.542623 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06f02d00-f1eb-45ad-a3c9-379e858b549c None None] Checking router: ae4f264c-d828-44a7-ab29-e11545372d21 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:32:51.551239 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06f02d00-f1eb-45ad-a3c9-379e858b549c None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:32:51.551844 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-06f02d00-f1eb-45ad-a3c9-379e858b549c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:32:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:32:51.571988 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0d37c5-c515-4999-b5dc-26af9f19acc6 req-d2204c37-69da-4f97-829c-8cf4eed0b404 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:32:51.573389 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e0d37c5-c515-4999-b5dc-26af9f19acc6 req-d2204c37-69da-4f97-829c-8cf4eed0b404 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0383110 Nov 18 18:32:51.655227 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-06f02d00-f1eb-45ad-a3c9-379e858b549c None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:32:51.666104 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e0d37c5-c515-4999-b5dc-26af9f19acc6 req-9d29bffe-2f53-4f76-b81c-7ee3108ecd36 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838423 Nov 18 18:32:51.755587 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-1e0d37c5-c515-4999-b5dc-26af9f19acc6 req-83f7d047-c2d6-45ba-88cf-ee823ab15417 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0808640 Nov 18 18:32:51.878510 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-06f02d00-f1eb-45ad-a3c9-379e858b549c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '989d6752-bf5c-4f42-b954-2aa48fb217d4', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.61', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:58:89:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:30:54Z', 'updated_at': '2021-11-18T18:30:56Z', 'revision_number': 1, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}, {'id': 'f802f580-15ed-4784-b023-14325ff52c1c', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.13', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:c7:f1:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:32:50Z', 'updated_at': '2021-11-18T18:32:50Z', 'revision_number': 0, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:32:51.907609 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06f02d00-f1eb-45ad-a3c9-379e858b549c None None] The sync data for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi is: [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '989d6752-bf5c-4f42-b954-2aa48fb217d4', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.61', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:58:89:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:30:54Z', 'updated_at': '2021-11-18T18:30:56Z', 'revision_number': 1, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}, {'id': 'f802f580-15ed-4784-b023-14325ff52c1c', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.13', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:c7:f1:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:32:50Z', 'updated_at': '2021-11-18T18:32:50Z', 'revision_number': 0, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:32:52.084411 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd0d8cc7-f3d7-4345-bb24-00bec0a55588 None None] New status for floating IP f802f580-15ed-4784-b023-14325ff52c1c: ACTIVE {{(pid=102691) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:33:04.006504 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-1010642f-d879-4feb-b61f-830614cf1c4a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:33:05.474545 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:33:06.453244 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-760d3079-b1a7-4287-93b0-37ce58c541fe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:33:07.746089 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:33:09.092625 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:33:10.204173 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:33:21.234920 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:33:24.494344 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc4cf578-9ba2-481d-99f6-b3d4a4f8af59 req-9c655984-77c0-42e3-8d67-1991899bd688 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0382481 Nov 18 18:33:24.582268 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc4cf578-9ba2-481d-99f6-b3d4a4f8af59 req-7a1af255-8605-44f3-a3fd-15faf23e45e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:33:24.583737 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc4cf578-9ba2-481d-99f6-b3d4a4f8af59 req-7a1af255-8605-44f3-a3fd-15faf23e45e0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 1098 time: 0.0435004 Nov 18 18:33:24.684363 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc4cf578-9ba2-481d-99f6-b3d4a4f8af59 req-6f4faf76-cae3-4ae9-b28a-f06b5f9fd452 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:33:24.686441 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc4cf578-9ba2-481d-99f6-b3d4a4f8af59 req-6f4faf76-cae3-4ae9-b28a-f06b5f9fd452 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 913 time: 0.0826592 Nov 18 18:33:24.752775 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc4cf578-9ba2-481d-99f6-b3d4a4f8af59 req-1007bad2-35d8-4987-a6c2-a57012867cee service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=689cc7a5-aee5-4e14-b7ee-55f33822a02c HTTP/1.1" status: 200 len: 1000 time: 0.0590625 Nov 18 18:33:24.802362 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc4cf578-9ba2-481d-99f6-b3d4a4f8af59 req-61e08ab9-42d7-40e6-830d-d7f4f7203259 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:33:24.803761 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc4cf578-9ba2-481d-99f6-b3d4a4f8af59 req-61e08ab9-42d7-40e6-830d-d7f4f7203259 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0430222 Nov 18 18:33:24.847841 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc4cf578-9ba2-481d-99f6-b3d4a4f8af59 req-1d094fe3-d011-4740-866d-dcd3af0db7b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:33:24.849326 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc4cf578-9ba2-481d-99f6-b3d4a4f8af59 req-1d094fe3-d011-4740-866d-dcd3af0db7b8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0376737 Nov 18 18:33:24.939184 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc4cf578-9ba2-481d-99f6-b3d4a4f8af59 req-56e53353-e1eb-435a-998e-b1512a771f2c service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820384 Nov 18 18:33:25.026649 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-fc4cf578-9ba2-481d-99f6-b3d4a4f8af59 req-e10528e1-0e5f-4ad8-b73c-682089be672e service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0787580 Nov 18 18:33:34.006592 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9fc2b48a-5e36-441a-bc60-9a884b261acc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:33:36.454212 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-ccda3807-9263-4518-88b4-be504b7c4a97 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:33:37.749847 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:33:39.096076 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:33:40.204308 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:33:42.473208 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:33:51.241954 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:04.007702 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-588f8b6f-c09d-4651-9452-f4190ab6ecf2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:06.455205 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-0b131875-bf28-4c15-b71d-db576e25dcae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:07.752286 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:09.095900 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:10.205471 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:19.472447 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:34:21.266242 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:22.614471 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46778) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:22.769386 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Deleting port f3442c6f-3221-441a-a372-f4da4812c9b4 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:34:22.769722 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:22.842370 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:22.842752 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:22.854962 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Calling delete_port for f3442c6f-3221-441a-a372-f4da4812c9b4 owned by network:floatingip {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:34:22.996950 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:23.020185 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event deleted for resources: {'Port': ['ID=f3442c6f-3221-441a-a372-f4da4812c9b4,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:23.033846 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:23.034206 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:23.034564 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:23.034909 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:23.035245 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:23.035583 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:23.035919 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:23.036273 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:23.036608 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:23.036936 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:23.037266 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:23.037593 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102689) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:23.091570 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:23.091904 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Floating IP f802f580-15ed-4784-b023-14325ff52c1c disassociated (deleted). External IP: 172.27.1.13, port: 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34. Nov 18 18:34:23.293911 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Router ae4f264c-d828-44a7-ab29-e11545372d21 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:34:23.398684 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:34:23.403224 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:23.410073 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-595eebb9-8385-4a2d-b2f2-818924e9fee3 None None] Sync routers for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:34:23.419605 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-595eebb9-8385-4a2d-b2f2-818924e9fee3 None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:34:23.420237 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-595eebb9-8385-4a2d-b2f2-818924e9fee3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:34:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:23.429836 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-7f07e04a-ba78-4c46-9d8b-204af8b7ca66 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "DELETE /v2.0/floatingips/f802f580-15ed-4784-b023-14325ff52c1c HTTP/1.1" status: 204 len: 168 time: 0.8143046 Nov 18 18:34:23.430413 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'tag': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:34:23.432668 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22e2086b-f888-453d-bc52-a9ac5575662c" -d '{"events": [{"name": "network-changed", "server_uuid": "2d0d5242-72ce-4819-8cc5-d87176d5fe20", "tag": "2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:34:23.481120 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:34:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-397a70c4-da36-4b1b-ac0e-a11b0d43ee23 x-openstack-request-id: req-397a70c4-da36-4b1b-ac0e-a11b0d43ee23 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:34:23.481423 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2d0d5242-72ce-4819-8cc5-d87176d5fe20", "tag": "2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:34:23.481680 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-397a70c4-da36-4b1b-ac0e-a11b0d43ee23 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:34:23.482084 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'tag': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34', 'status': 'completed', 'code': 200} Nov 18 18:34:23.541980 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-595eebb9-8385-4a2d-b2f2-818924e9fee3 None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:34:23.550742 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e2086b-f888-453d-bc52-a9ac5575662c req-788e1b90-9e24-416e-9369-95955aec209b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:23.552735 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22e2086b-f888-453d-bc52-a9ac5575662c req-788e1b90-9e24-416e-9369-95955aec209b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 1098 time: 0.0480039 Nov 18 18:34:23.680715 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e2086b-f888-453d-bc52-a9ac5575662c req-a7740e00-818e-4623-9434-960aeaa776f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:23.682295 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22e2086b-f888-453d-bc52-a9ac5575662c req-a7740e00-818e-4623-9434-960aeaa776f8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 913 time: 0.1174376 Nov 18 18:34:23.695204 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95482d09-5a9b-40a3-b117-d2e9e01a8b6e req-3f6e337d-6f4e-4f92-bde0-d87f27929de5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:23.696785 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-95482d09-5a9b-40a3-b117-d2e9e01a8b6e req-3f6e337d-6f4e-4f92-bde0-d87f27929de5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 945 time: 0.0717421 Nov 18 18:34:23.746443 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22e2086b-f888-453d-bc52-a9ac5575662c req-4735b3da-757d-4d7c-af4b-8a8791ae5cd5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 HTTP/1.1" status: 200 len: 217 time: 0.0486665 Nov 18 18:34:23.807287 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-95482d09-5a9b-40a3-b117-d2e9e01a8b6e req-c16da9f5-714c-40c3-b2cf-335040cf4d82 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1032124 Nov 18 18:34:23.818571 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e2086b-f888-453d-bc52-a9ac5575662c req-f9d9ef29-4f3b-40ec-9767-1d92c67fbcc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:23.819997 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22e2086b-f888-453d-bc52-a9ac5575662c req-f9d9ef29-4f3b-40ec-9767-1d92c67fbcc0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0612805 Nov 18 18:34:23.868803 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e2086b-f888-453d-bc52-a9ac5575662c req-13d6085d-fa16-4a3e-b90d-7b47ee158b0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:23.870277 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22e2086b-f888-453d-bc52-a9ac5575662c req-13d6085d-fa16-4a3e-b90d-7b47ee158b0d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0386913 Nov 18 18:34:23.890316 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-595eebb9-8385-4a2d-b2f2-818924e9fee3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '989d6752-bf5c-4f42-b954-2aa48fb217d4', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.61', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:58:89:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:30:54Z', 'updated_at': '2021-11-18T18:30:56Z', 'revision_number': 1, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:23.916486 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-595eebb9-8385-4a2d-b2f2-818924e9fee3 None None] Checking router: ae4f264c-d828-44a7-ab29-e11545372d21 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:34:23.925290 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-595eebb9-8385-4a2d-b2f2-818924e9fee3 None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:34:23.925901 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-595eebb9-8385-4a2d-b2f2-818924e9fee3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:34:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:23.963468 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22e2086b-f888-453d-bc52-a9ac5575662c req-1e3337fa-d163-4ff9-9e38-e84bb5a639dc service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841429 Nov 18 18:34:24.028561 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-595eebb9-8385-4a2d-b2f2-818924e9fee3 None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:34:24.063048 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-22e2086b-f888-453d-bc52-a9ac5575662c req-ee2cbb3c-fa37-4c5e-b4ab-1fb325a9d3ab service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858521 Nov 18 18:34:24.251422 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-595eebb9-8385-4a2d-b2f2-818924e9fee3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '989d6752-bf5c-4f42-b954-2aa48fb217d4', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.61', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:58:89:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:30:54Z', 'updated_at': '2021-11-18T18:30:56Z', 'revision_number': 1, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:24.277401 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-595eebb9-8385-4a2d-b2f2-818924e9fee3 None None] The sync data for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi is: [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_floatingips': [{'id': '989d6752-bf5c-4f42-b954-2aa48fb217d4', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'floating_ip_address': '172.27.1.61', 'floating_network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'router_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'port_id': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'mac_address': 'fa:16:3e:58:89:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T18:30:54Z', 'updated_at': '2021-11-18T18:30:56Z', 'revision_number': 1, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:34:24.483809 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4df158c7-da3e-4ec8-8618-c8b0a4af9613 None None] New status for floating IP f802f580-15ed-4784-b023-14325ff52c1c: DOWN {{(pid=102691) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:34:24.922472 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-055dab69-4d72-4302-83a3-693cf3016bea req-82248e38-adad-4437-9309-ae9728003dff tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:24.924185 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-055dab69-4d72-4302-83a3-693cf3016bea req-82248e38-adad-4437-9309-ae9728003dff tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 945 time: 0.0484145 Nov 18 18:34:24.971748 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-055dab69-4d72-4302-83a3-693cf3016bea req-ee60c0f7-dbf9-46a3-b79e-af383535b296 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417519 Nov 18 18:34:25.376260 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edbbe19f-5193-4647-a3b3-54078fe3afc0 req-daaf3ca1-5a63-4cbf-8fda-8016ce7c8118 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:25.377687 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-edbbe19f-5193-4647-a3b3-54078fe3afc0 req-daaf3ca1-5a63-4cbf-8fda-8016ce7c8118 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 945 time: 0.0466263 Nov 18 18:34:25.465055 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-edbbe19f-5193-4647-a3b3-54078fe3afc0 req-408d948c-5325-4750-a8b8-62c4f54fe9a5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Deleting port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:34:25.465388 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-edbbe19f-5193-4647-a3b3-54078fe3afc0 req-408d948c-5325-4750-a8b8-62c4f54fe9a5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:25.551430 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-edbbe19f-5193-4647-a3b3-54078fe3afc0 req-408d948c-5325-4750-a8b8-62c4f54fe9a5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] For port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:34:25.551783 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-edbbe19f-5193-4647-a3b3-54078fe3afc0 req-408d948c-5325-4750-a8b8-62c4f54fe9a5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:25.564007 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-edbbe19f-5193-4647-a3b3-54078fe3afc0 req-408d948c-5325-4750-a8b8-62c4f54fe9a5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Calling delete_port for 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:34:25.689704 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-edbbe19f-5193-4647-a3b3-54078fe3afc0 req-408d948c-5325-4750-a8b8-62c4f54fe9a5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:25.716615 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-408d948c-5325-4750-a8b8-62c4f54fe9a5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event deleted for resources: {'Port': ['ID=2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:25.760179 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-edbbe19f-5193-4647-a3b3-54078fe3afc0 req-408d948c-5325-4750-a8b8-62c4f54fe9a5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] No DVR routers for this DVR port 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:34:25.762847 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-edbbe19f-5193-4647-a3b3-54078fe3afc0 req-408d948c-5325-4750-a8b8-62c4f54fe9a5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:25.767051 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-edbbe19f-5193-4647-a3b3-54078fe3afc0 req-408d948c-5325-4750-a8b8-62c4f54fe9a5 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "DELETE /v2.0/ports/2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 HTTP/1.1" status: 204 len: 173 time: 0.3824458 Nov 18 18:34:25.767506 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'name': 'network-vif-deleted', 'tag': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:34:25.770370 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13be1c11-d988-471d-bf25-d6cefbca141d" -d '{"events": [{"server_uuid": "2d0d5242-72ce-4819-8cc5-d87176d5fe20", "name": "network-vif-deleted", "tag": "2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:34:25.807799 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:34:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e9941666-962f-4d76-8767-8ab419ad5e23 x-openstack-request-id: req-e9941666-962f-4d76-8767-8ab419ad5e23 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:34:25.808127 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2d0d5242-72ce-4819-8cc5-d87176d5fe20", "name": "network-vif-deleted", "tag": "2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:34:25.808381 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-e9941666-962f-4d76-8767-8ab419ad5e23 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:34:25.808781 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2d0d5242-72ce-4819-8cc5-d87176d5fe20', 'name': 'network-vif-deleted', 'tag': '2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34', 'status': 'completed', 'code': 200} Nov 18 18:34:26.070710 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-76c82494-d560-411a-8105-88cb13ef70e4 req-e2a44ee7-097a-4b2b-96e0-5f5a3ff3e57f tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 210 time: 0.0282550 Nov 18 18:34:26.531706 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4b11a495-e2e2-4058-a120-0125d27a760b req-71a1e48b-b5b4-4fdb-a66b-6d5b7f073f11 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0273268 Nov 18 18:34:26.582167 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4b11a495-e2e2-4058-a120-0125d27a760b req-70a602c8-70fc-49ea-b6fd-a78c7e9f51bc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=2d0d5242-72ce-4819-8cc5-d87176d5fe20 HTTP/1.1" status: 200 len: 210 time: 0.0244377 Nov 18 18:34:26.693292 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b11a495-e2e2-4058-a120-0125d27a760b req-50a355e4-6936-4099-be55-26d3e2bfeda7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:26.694650 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4b11a495-e2e2-4058-a120-0125d27a760b req-50a355e4-6936-4099-be55-26d3e2bfeda7 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=d08a29a317934e72a71b69340d23cd0b&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0921075 Nov 18 18:34:26.785007 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b11a495-e2e2-4058-a120-0125d27a760b req-d990587a-34bf-4411-9b26-1389800597ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:26.786956 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-4b11a495-e2e2-4058-a120-0125d27a760b req-d990587a-34bf-4411-9b26-1389800597ae service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.0850549 Nov 18 18:34:29.285717 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:34:29.305222 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:34:29.305570 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 2ee09c9d-f8d5-4137-b0d5-2e5ad30aec34 not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:34:29.336761 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46818) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:29.487286 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Deleting port 4c5d883b-ed42-4adf-8dda-1473beaf42d7 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:34:29.487622 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:29.566681 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:29.566900 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:29.578806 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Calling delete_port for 4c5d883b-ed42-4adf-8dda-1473beaf42d7 owned by network:floatingip {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:34:29.720772 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:29.744745 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event deleted for resources: {'Port': ['ID=4c5d883b-ed42-4adf-8dda-1473beaf42d7,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:29.802885 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:29.803208 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.db.l3_db [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Floating IP 989d6752-bf5c-4f42-b954-2aa48fb217d4 disassociated (deleted). External IP: 172.27.1.61, port: 689cc7a5-aee5-4e14-b7ee-55f33822a02c. Nov 18 18:34:30.002403 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Router ae4f264c-d828-44a7-ab29-e11545372d21 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102689) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:34:30.106065 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102689) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:34:30.111386 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:30.116382 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5058a6c-0439-475f-9917-dbf5416e3a3d None None] Sync routers for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:34:30.125400 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5058a6c-0439-475f-9917-dbf5416e3a3d None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:34:30.125997 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e5058a6c-0439-475f-9917-dbf5416e3a3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:34:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:30.137066 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-2ee1ecc8-0878-4d9d-afd8-c98f09dd06db tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "DELETE /v2.0/floatingips/989d6752-bf5c-4f42-b954-2aa48fb217d4 HTTP/1.1" status: 204 len: 168 time: 0.7992463 Nov 18 18:34:30.137652 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'tag': '689cc7a5-aee5-4e14-b7ee-55f33822a02c'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:34:30.139893 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0683be43-b5f2-43e1-a5bd-74ed9e460cdb" -d '{"events": [{"name": "network-changed", "server_uuid": "4f8b0b89-3e7d-4d91-b089-84b81f556a6b", "tag": "689cc7a5-aee5-4e14-b7ee-55f33822a02c"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:34:30.184024 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 18:34:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a9a4e903-1766-41c4-b3d5-005260c05003 x-openstack-request-id: req-a9a4e903-1766-41c4-b3d5-005260c05003 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:34:30.184024 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4f8b0b89-3e7d-4d91-b089-84b81f556a6b", "tag": "689cc7a5-aee5-4e14-b7ee-55f33822a02c", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:34:30.184024 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-a9a4e903-1766-41c4-b3d5-005260c05003 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:34:30.184024 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'tag': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'status': 'completed', 'code': 200} Nov 18 18:34:30.242096 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-e5058a6c-0439-475f-9917-dbf5416e3a3d None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:34:30.260142 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0683be43-b5f2-43e1-a5bd-74ed9e460cdb req-2e4ddec3-8342-4216-a05e-05b4ebb08b1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:30.261628 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0683be43-b5f2-43e1-a5bd-74ed9e460cdb req-2e4ddec3-8342-4216-a05e-05b4ebb08b1f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d08a29a317934e72a71b69340d23cd0b&device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 1098 time: 0.0501966 Nov 18 18:34:30.360198 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0683be43-b5f2-43e1-a5bd-74ed9e460cdb req-90bd78aa-d595-435f-b522-193ace93bb50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:30.362563 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0683be43-b5f2-43e1-a5bd-74ed9e460cdb req-90bd78aa-d595-435f-b522-193ace93bb50 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 200 len: 913 time: 0.0924065 Nov 18 18:34:30.410534 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0683be43-b5f2-43e1-a5bd-74ed9e460cdb req-e4bbb559-caed-4044-a9e2-95dd5ffdbdf5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=689cc7a5-aee5-4e14-b7ee-55f33822a02c HTTP/1.1" status: 200 len: 217 time: 0.0399132 Nov 18 18:34:30.454312 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e5058a6c-0439-475f-9917-dbf5416e3a3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:30.479493 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0683be43-b5f2-43e1-a5bd-74ed9e460cdb req-37af1ce9-ea74-48cb-956c-a7d60cb3c33d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:30.480944 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0683be43-b5f2-43e1-a5bd-74ed9e460cdb req-37af1ce9-ea74-48cb-956c-a7d60cb3c33d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 200 len: 850 time: 0.0545435 Nov 18 18:34:30.482075 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5058a6c-0439-475f-9917-dbf5416e3a3d None None] Checking router: ae4f264c-d828-44a7-ab29-e11545372d21 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:34:30.490519 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5058a6c-0439-475f-9917-dbf5416e3a3d None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:34:30.491114 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e5058a6c-0439-475f-9917-dbf5416e3a3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:34:06Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:30.538002 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d788fb3-0385-4a02-8b83-611827c40f53 req-36a52e2c-ec69-4f37-acf7-1692d89523d4 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:30.539364 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8d788fb3-0385-4a02-8b83-611827c40f53 req-36a52e2c-ec69-4f37-acf7-1692d89523d4 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 945 time: 0.0751154 Nov 18 18:34:30.550564 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0683be43-b5f2-43e1-a5bd-74ed9e460cdb req-93d67a6f-d4b2-49d9-ac9e-54ba59c6f2b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:30.552036 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0683be43-b5f2-43e1-a5bd-74ed9e460cdb req-93d67a6f-d4b2-49d9-ac9e-54ba59c6f2b0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1cf7f705-4c7c-4525-bcfb-71db85eb96a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0582089 Nov 18 18:34:30.596642 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-e5058a6c-0439-475f-9917-dbf5416e3a3d None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:34:30.647399 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-8d788fb3-0385-4a02-8b83-611827c40f53 req-3a59c4cb-baa8-4cd6-8130-63e081f48622 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0995533 Nov 18 18:34:30.674108 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0683be43-b5f2-43e1-a5bd-74ed9e460cdb req-58feddf9-7c8d-4b31-a29e-2edb70023563 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1090267 Nov 18 18:34:30.769174 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-0683be43-b5f2-43e1-a5bd-74ed9e460cdb req-a000ba10-8f02-443a-b133-6d1e5256c161 service neutron] 10.222.0.31 "GET /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867283 Nov 18 18:34:30.796279 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-e5058a6c-0439-475f-9917-dbf5416e3a3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:30.821946 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5058a6c-0439-475f-9917-dbf5416e3a3d None None] The sync data for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi is: [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:27:30Z', 'revision_number': 4, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi', '_interfaces': [{'id': '59ef5d7e-9855-4844-9c64-f9bd52c8d1c4', 'name': '', 'network_id': '1cf7f705-4c7c-4525-bcfb-71db85eb96a0', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'mac_address': 'fa:16:3e:9c:dd:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:30Z', 'updated_at': '2021-11-18T18:27:35Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'subnets': [{'id': '3cd0c89d-cb17-425f-b060-6f88dbc2e31b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:34:31.024709 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c822b1ff-c00f-43f0-a6e5-7d591a2c6904 None None] New status for floating IP 989d6752-bf5c-4f42-b954-2aa48fb217d4: DOWN {{(pid=102691) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 18:34:32.011964 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b36600de-8c4d-41bb-8795-423fe7e80c92 req-f9947a83-4628-40c7-9d34-e172f953913e tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:32.013377 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b36600de-8c4d-41bb-8795-423fe7e80c92 req-f9947a83-4628-40c7-9d34-e172f953913e tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 945 time: 0.2953029 Nov 18 18:34:32.060150 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-b36600de-8c4d-41bb-8795-423fe7e80c92 req-602c6465-f644-48ee-be89-bd0972c95079 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/security-groups?id=dd44e10b-bbd9-463d-98f3-ddfd17eace36&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407858 Nov 18 18:34:32.128730 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01e9df42-3070-46c7-8c62-61a626085d51 req-4299b0c3-f51c-4205-9409-ddce6fa2ad49 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102689) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 18:34:32.130155 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-01e9df42-3070-46c7-8c62-61a626085d51 req-4299b0c3-f51c-4205-9409-ddce6fa2ad49 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 945 time: 0.0467541 Nov 18 18:34:32.218157 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-01e9df42-3070-46c7-8c62-61a626085d51 req-e14e28ac-f89e-4b5c-849d-c13012b0c066 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Deleting port 689cc7a5-aee5-4e14-b7ee-55f33822a02c {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:34:32.218491 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-01e9df42-3070-46c7-8c62-61a626085d51 req-e14e28ac-f89e-4b5c-849d-c13012b0c066 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:32.303811 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [req-01e9df42-3070-46c7-8c62-61a626085d51 req-e14e28ac-f89e-4b5c-849d-c13012b0c066 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] For port 689cc7a5-aee5-4e14-b7ee-55f33822a02c, host hv-cinder-78776, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78776',level=0,port_id=689cc7a5-aee5-4e14-b7ee-55f33822a02c,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:34:32.304113 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-01e9df42-3070-46c7-8c62-61a626085d51 req-e14e28ac-f89e-4b5c-849d-c13012b0c066 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:32.316743 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [req-01e9df42-3070-46c7-8c62-61a626085d51 req-e14e28ac-f89e-4b5c-849d-c13012b0c066 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Calling delete_port for 689cc7a5-aee5-4e14-b7ee-55f33822a02c owned by compute:nova {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:34:32.438244 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-01e9df42-3070-46c7-8c62-61a626085d51 req-e14e28ac-f89e-4b5c-849d-c13012b0c066 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:32.464180 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e14e28ac-f89e-4b5c-849d-c13012b0c066 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event deleted for resources: {'Port': ['ID=689cc7a5-aee5-4e14-b7ee-55f33822a02c,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:32.509597 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [req-01e9df42-3070-46c7-8c62-61a626085d51 req-e14e28ac-f89e-4b5c-849d-c13012b0c066 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] No DVR routers for this DVR port 689cc7a5-aee5-4e14-b7ee-55f33822a02c on host hv-cinder-78776 {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:34:32.511977 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [req-01e9df42-3070-46c7-8c62-61a626085d51 req-e14e28ac-f89e-4b5c-849d-c13012b0c066 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for port, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:32.515259 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-01e9df42-3070-46c7-8c62-61a626085d51 req-e14e28ac-f89e-4b5c-849d-c13012b0c066 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.31 "DELETE /v2.0/ports/689cc7a5-aee5-4e14-b7ee-55f33822a02c HTTP/1.1" status: 204 len: 173 time: 0.3782954 Nov 18 18:34:32.515740 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'name': 'network-vif-deleted', 'tag': '689cc7a5-aee5-4e14-b7ee-55f33822a02c'}] {{(pid=102689) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 18:34:32.518054 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f0d76822951468ebe52b7dba6cba2f07bc5bf74bb3b9580b676b5b33c7d06be3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68fb87c4-630a-49df-b92c-a30056ca2eb8" -d '{"events": [{"server_uuid": "4f8b0b89-3e7d-4d91-b089-84b81f556a6b", "name": "network-vif-deleted", "tag": "689cc7a5-aee5-4e14-b7ee-55f33822a02c"}]}' {{(pid=102689) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 18:34:32.556013 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 18:34:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7954e492-c840-4245-9295-2906334ea691 x-openstack-request-id: req-7954e492-c840-4245-9295-2906334ea691 {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 18:34:32.556313 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4f8b0b89-3e7d-4d91-b089-84b81f556a6b", "name": "network-vif-deleted", "tag": "689cc7a5-aee5-4e14-b7ee-55f33822a02c", "status": "completed", "code": 200}]} {{(pid=102689) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 18:34:32.556676 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-7954e492-c840-4245-9295-2906334ea691 {{(pid=102689) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 18:34:32.557080 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4f8b0b89-3e7d-4d91-b089-84b81f556a6b', 'name': 'network-vif-deleted', 'tag': '689cc7a5-aee5-4e14-b7ee-55f33822a02c', 'status': 'completed', 'code': 200} Nov 18 18:34:33.166906 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [req-86b8af4f-2638-4846-afee-f9b9d228588e req-5d4df7d8-46e7-472a-b590-004b5d7da7c2 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "GET /v2.0/ports?device_id=4f8b0b89-3e7d-4d91-b089-84b81f556a6b HTTP/1.1" status: 200 len: 210 time: 0.0266354 Nov 18 18:34:34.008533 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5aa969ee-607a-45df-8629-324c50168a23 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:34.221494 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46834) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:34.339529 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-c0c798ff-816e-45be-93ae-0387298f752a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Deleting port d903e57f-385c-4cf9-af46-da8862086747 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:34:34.339858 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0c798ff-816e-45be-93ae-0387298f752a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:34.412656 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0c798ff-816e-45be-93ae-0387298f752a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:34.412985 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0c798ff-816e-45be-93ae-0387298f752a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:34.424701 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-c0c798ff-816e-45be-93ae-0387298f752a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Calling delete_port for d903e57f-385c-4cf9-af46-da8862086747 owned by network:floatingip {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:34:34.550089 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0c798ff-816e-45be-93ae-0387298f752a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:34.574263 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0c798ff-816e-45be-93ae-0387298f752a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event deleted for resources: {'Port': ['ID=d903e57f-385c-4cf9-af46-da8862086747,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:34.635110 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0c798ff-816e-45be-93ae-0387298f752a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for floatingip, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:34.637693 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-c0c798ff-816e-45be-93ae-0387298f752a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-77242'] for floatingip, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:34.638842 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-c0c798ff-816e-45be-93ae-0387298f752a tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "DELETE /v2.0/floatingips/c515b9f1-ac39-4719-b3db-b5ca3ba6d43f HTTP/1.1" status: 204 len: 168 time: 0.4163518 Nov 18 18:34:35.302152 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 689cc7a5-aee5-4e14-b7ee-55f33822a02c no longer exists at agent hyperv_hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:34:35.325058 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] No Port match for: 689cc7a5-aee5-4e14-b7ee-55f33822a02c {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:34:35.325389 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Device 689cc7a5-aee5-4e14-b7ee-55f33822a02c not bound to the agent host hv-cinder-78776 {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:34:35.820181 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46848) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:35.874976 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-132b2dd7-cc64-495d-becc-ed3958aac488 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:35.898727 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-132b2dd7-cc64-495d-becc-ed3958aac488 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:35.956929 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-132b2dd7-cc64-495d-becc-ed3958aac488 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:35.959532 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-132b2dd7-cc64-495d-becc-ed3958aac488 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Publish callbacks [] for security_group, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:35.960691 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-132b2dd7-cc64-495d-becc-ed3958aac488 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] 10.222.0.82 "DELETE /v2.0/security-groups/dd44e10b-bbd9-463d-98f3-ddfd17eace36 HTTP/1.1" status: 204 len: 168 time: 0.1395216 Nov 18 18:34:35.970670 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-132b2dd7-cc64-495d-becc-ed3958aac488 tempest-TestVolumeBootPattern-125315396 tempest-TestVolumeBootPattern-125315396-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd44e10b-bbd9-463d-98f3-ddfd17eace36,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:36.458433 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5b311a6c-87ac-42f4-9c32-f5efc7f76590 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:37.037107 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46854) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:37.563850 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-499121'] for router_interface, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:37.754721 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:37.805859 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Deleting port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:34:37.806192 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:37.884392 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] For port 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=59ef5d7e-9855-4844-9c64-f9bd52c8d1c4,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:34:37.884781 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:37.897473 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Calling delete_port for 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 owned by network:router_interface {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:34:38.071823 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:38.096389 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Pushing event deleted for resources: {'Port': ['ID=59ef5d7e-9855-4844-9c64-f9bd52c8d1c4,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:38.119648 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:38.120024 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:38.120373 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:38.120708 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:38.121040 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:38.121368 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:38.121697 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:38.122022 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:38.122349 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:38.122673 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:38.122993 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:38.123319 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787764-6-iscsi {{(pid=102688) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 18:34:38.265224 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1772491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-498973'] for router_interface, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:38.468808 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Router ae4f264c-d828-44a7-ab29-e11545372d21 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102688) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:34:38.575821 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:34:38.583186 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-ea6abdcb-9642-422d-8259-965d11e6c45e admin admin] 10.222.0.82 "PUT /v2.0/routers/ae4f264c-d828-44a7-ab29-e11545372d21/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5448606 Nov 18 18:34:38.583698 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46860) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:38.585490 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51f14afc-0931-4e61-9a0b-e057a1d884eb None None] Sync routers for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:34:38.595389 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51f14afc-0931-4e61-9a0b-e057a1d884eb None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:34:38.596271 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-51f14afc-0931-4e61-9a0b-e057a1d884eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:34:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:38.687809 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Publish callbacks [] for router, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:38.699576 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-51f14afc-0931-4e61-9a0b-e057a1d884eb None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:34:38.792267 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:38.846557 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Deleting port 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:34:38.846898 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:38.928269 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] For port 8d3b49b4-83a1-4a8c-8afd-4e904bba5162, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=8d3b49b4-83a1-4a8c-8afd-4e904bba5162,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:34:38.928631 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:38.941311 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Calling delete_port for 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 owned by network:router_gateway {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:34:38.997268 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-51f14afc-0931-4e61-9a0b-e057a1d884eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:34:38Z', 'revision_number': 5, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port': {'id': '8d3b49b4-83a1-4a8c-8afd-4e904bba5162', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:70:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:28Z', 'updated_at': '2021-11-18T18:27:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:39.027022 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51f14afc-0931-4e61-9a0b-e057a1d884eb None None] Checking router: ae4f264c-d828-44a7-ab29-e11545372d21 for host: dv-cinder-787764-6-iscsi {{(pid=102690) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:34:39.036092 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51f14afc-0931-4e61-9a0b-e057a1d884eb None None] Routers {'ae4f264c-d828-44a7-ab29-e11545372d21'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102690) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:34:39.036708 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-51f14afc-0931-4e61-9a0b-e057a1d884eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:34:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['ae4f264c-d828-44a7-ab29-e11545372d21'], 'active': True} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:39.105224 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.124171 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.131878 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Pushing event deleted for resources: {'Port': ['ID=8d3b49b4-83a1-4a8c-8afd-4e904bba5162,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:39.137760 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_dvr_db [None req-51f14afc-0931-4e61-9a0b-e057a1d884eb None None] Set router ae4f264c-d828-44a7-ab29-e11545372d21 gateway port host: None {{(pid=102690) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:34:39.189655 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-500475'] for router_gateway, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.189915 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.db.l3_hamode_db [None req-51f14afc-0931-4e61-9a0b-e057a1d884eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:34:38Z', 'revision_number': 6, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port_host': None}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102690) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:39.219910 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51f14afc-0931-4e61-9a0b-e057a1d884eb None None] The sync data for ids ['ae4f264c-d828-44a7-ab29-e11545372d21'] in dv-cinder-787764-6-iscsi is: [{'id': 'ae4f264c-d828-44a7-ab29-e11545372d21', 'name': 'tempest-TestVolumeBootPattern-182033318-router', 'tenant_id': 'd08a29a317934e72a71b69340d23cd0b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:27Z', 'updated_at': '2021-11-18T18:34:38Z', 'revision_number': 6, 'project_id': 'd08a29a317934e72a71b69340d23cd0b', 'gw_port_host': None}] {{(pid=102690) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:34:39.279979 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-430336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-557'] for router, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.282055 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.325953 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-430347'] for router, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.326497 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ae4f264c-d828-44a7-ab29-e11545372d21 {{(pid=102688) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 18:34:39.331327 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] Publish callbacks [] for router, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.332621 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-bf42032f-5820-4d47-a4f4-0bd585937605 admin admin] 10.222.0.82 "DELETE /v2.0/routers/ae4f264c-d828-44a7-ab29-e11545372d21 HTTP/1.1" status: 204 len: 168 time: 0.7478974 Nov 18 18:34:39.335113 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46862) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:39.378363 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_v2 [None req-c2ca2332-4211-41f7-a8ba-aa94989eb174 admin admin] Deleting subnet 3cd0c89d-cb17-425f-b060-6f88dbc2e31b {{(pid=102688) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:34:39.381329 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c2ca2332-4211-41f7-a8ba-aa94989eb174 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.414827 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c2ca2332-4211-41f7-a8ba-aa94989eb174 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14253791'] for subnet, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.492735 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c2ca2332-4211-41f7-a8ba-aa94989eb174 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.548452 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c2ca2332-4211-41f7-a8ba-aa94989eb174 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-13993132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14505899'] for subnet, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.574107 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2ca2332-4211-41f7-a8ba-aa94989eb174 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3cd0c89d-cb17-425f-b060-6f88dbc2e31b,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:39.577786 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-c2ca2332-4211-41f7-a8ba-aa94989eb174 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.582243 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-c2ca2332-4211-41f7-a8ba-aa94989eb174 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/3cd0c89d-cb17-425f-b060-6f88dbc2e31b HTTP/1.1" status: 204 len: 168 time: 0.2457135 Nov 18 18:34:39.584582 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.wsgi [-] (102689) accepted ('10.222.0.82', 46864) {{(pid=102689) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:39.585459 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7f42a7c-0bc3-4a99-aea5-80c9c25ab8bd None None] Network 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:34:39.667231 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.719323 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Deleting port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 {{(pid=102689) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:34:39.719661 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.787310 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.db [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] For port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=15dd6d29-6d36-494a-b22e-ef14c2c2c5e1,segment=NetworkSegment(50c99b05-6341-4b99-80f2-ffdf7a114b2c),segment_id=50c99b05-6341-4b99-80f2-ffdf7a114b2c)] {{(pid=102689) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:34:39.787670 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.799272 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.plugin [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Calling delete_port for 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 owned by network:dhcp {{(pid=102689) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:34:39.877085 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12723926'] for port, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.904309 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] No DVR routers for this DVR port 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 on host dv-cinder-787764-6-iscsi {{(pid=102689) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:34:39.905847 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Pushing event deleted for resources: {'Port': ['ID=15dd6d29-6d36-494a-b22e-ef14c2c2c5e1,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:39.978228 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:39.998683 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1cf7f705-4c7c-4525-bcfb-71db85eb96a0']}} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:40.011795 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-833e516f-d13e-49da-9d0e-824efaf49cac None None] DHCP port deletion for 1cf7f705-4c7c-4525-bcfb-71db85eb96a0 request from dv-cinder-787764-6-iscsi {{(pid=102690) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 18:34:40.012602 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '50c99b05-6341-4b99-80f2-ffdf7a114b2c') {'for_net_delete': True} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:40.012904 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.services.segments.db [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '50c99b05-6341-4b99-80f2-ffdf7a114b2c') {} {{(pid=102689) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:40.023473 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12724807'] for segment, before_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:40.038870 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:40.045099 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Releasing vlan 1326 on physical network physnet1 to pool {{(pid=102689) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:34:40.045482 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12723877'] for segment, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: Traceback (most recent call last): Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: timer() Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: cb(*args, **kw) Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: return func(*args, **kwargs) Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: self._notify() Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: self.callback(batched_events) Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: event.method(event) Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: return f(self, *a, **k) Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._get(url).json() Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: return self.request(url, 'GET', **kwargs) Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:34:40.047328 dv-cinder-787764-6-iscsi neutron-server[102689]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:34:40.104645 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:40.110097 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron_lib.callbacks.manager [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102689) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:40.113851 dv-cinder-787764-6-iscsi neutron-server[102689]: INFO neutron.wsgi [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] 10.222.0.82 "DELETE /v2.0/networks/1cf7f705-4c7c-4525-bcfb-71db85eb96a0 HTTP/1.1" status: 204 len: 168 time: 0.5282719 Nov 18 18:34:40.120410 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46866) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:40.130977 dv-cinder-787764-6-iscsi neutron-server[102689]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc378e43-4ae4-43bf-8dfd-56736a37c707 admin admin] Pushing event deleted for resources: {'Network': ['ID=1cf7f705-4c7c-4525-bcfb-71db85eb96a0,revision_number=None']} {{(pid=102689) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:40.212499 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:40.459999 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7de0167c-7537-4c32-89eb-625c8f530149 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-499121'] for router_interface, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:40.614115 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:34:40.635010 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:34:40.635354 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 8d3b49b4-83a1-4a8c-8afd-4e904bba5162 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:34:40.635783 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:34:40.655829 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:34:40.656201 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 15dd6d29-6d36-494a-b22e-ef14c2c2c5e1 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:34:40.656624 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:34:40.676803 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:34:40.677142 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 59ef5d7e-9855-4844-9c64-f9bd52c8d1c4 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:34:40.921115 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-7de0167c-7537-4c32-89eb-625c8f530149 admin admin] Deleting port f9457714-1f9d-4edc-b7d1-f887e78aae31 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:34:40.921453 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7de0167c-7537-4c32-89eb-625c8f530149 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:40.999678 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-7de0167c-7537-4c32-89eb-625c8f530149 admin admin] For port f9457714-1f9d-4edc-b7d1-f887e78aae31, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=f9457714-1f9d-4edc-b7d1-f887e78aae31,segment=NetworkSegment(e6aef544-870a-47a3-abc8-6d59806d8d81),segment_id=e6aef544-870a-47a3-abc8-6d59806d8d81)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:34:41.000072 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7de0167c-7537-4c32-89eb-625c8f530149 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:41.012910 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-7de0167c-7537-4c32-89eb-625c8f530149 admin admin] Calling delete_port for f9457714-1f9d-4edc-b7d1-f887e78aae31 owned by network:router_interface {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:34:41.185011 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7de0167c-7537-4c32-89eb-625c8f530149 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:41.210657 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7de0167c-7537-4c32-89eb-625c8f530149 admin admin] Pushing event deleted for resources: {'Port': ['ID=f9457714-1f9d-4edc-b7d1-f887e78aae31,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:41.374686 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7de0167c-7537-4c32-89eb-625c8f530149 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1772491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-498973'] for router_interface, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:41.583522 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7de0167c-7537-4c32-89eb-625c8f530149 admin admin] Router 1a2f271d-7fab-4f5f-a89a-e4300686f754 has already been hosted by L3 agent 389a2729-17ab-41c8-acde-af571e6e3037 {{(pid=102688) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 18:34:41.688132 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7de0167c-7537-4c32-89eb-625c8f530149 admin admin] Notify agent at l3_agent.dv-cinder-787764-6-iscsi the message routers_updated {{(pid=102688) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 18:34:41.693757 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-7de0167c-7537-4c32-89eb-625c8f530149 admin admin] 10.222.0.82 "PUT /v2.0/routers/1a2f271d-7fab-4f5f-a89a-e4300686f754/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5755148 Nov 18 18:34:41.696135 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46868) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:41.696855 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98314caf-3173-4226-a3ff-9454e9556b3e None None] Sync routers for ids ['1a2f271d-7fab-4f5f-a89a-e4300686f754'] in dv-cinder-787764-6-iscsi {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 18:34:41.707489 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98314caf-3173-4226-a3ff-9454e9556b3e None None] Routers {'1a2f271d-7fab-4f5f-a89a-e4300686f754'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:34:41.708126 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-98314caf-3173-4226-a3ff-9454e9556b3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:34:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['1a2f271d-7fab-4f5f-a89a-e4300686f754'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:41.802354 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Publish callbacks [] for router, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:41.809832 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-98314caf-3173-4226-a3ff-9454e9556b3e None None] Set router 1a2f271d-7fab-4f5f-a89a-e4300686f754 gateway port host: dv-cinder-787764-6-iscsi {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:34:41.902706 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:41.954968 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Deleting port f86b5f54-d766-4cb3-8202-830d3b24369a {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:34:41.955313 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:41.988134 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-98314caf-3173-4226-a3ff-9454e9556b3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'name': 'tempest-TestVolumeBootPattern-346410515-router', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'external_fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130'}], 'enable_snat': True}, 'gw_port_id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:32Z', 'updated_at': '2021-11-18T18:34:41Z', 'revision_number': 5, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'gw_port': {'id': 'f86b5f54-d766-4cb3-8202-830d3b24369a', 'name': '', 'network_id': '2cab888d-52a8-434c-814e-4f25740decd0', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:32:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'device_owner': 'network:router_gateway', 'standard_attr_id': 557, 'fixed_ips': [{'subnet_id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'ip_address': '172.27.1.130', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787764-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T18:27:33Z', 'updated_at': '2021-11-18T18:27:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '27c45147-26a4-4b40-9fdf-2f6fc0a394bf', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787764-6-iscsi'}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:42.015083 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98314caf-3173-4226-a3ff-9454e9556b3e None None] Checking router: 1a2f271d-7fab-4f5f-a89a-e4300686f754 for host: dv-cinder-787764-6-iscsi {{(pid=102691) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 18:34:42.023758 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98314caf-3173-4226-a3ff-9454e9556b3e None None] Routers {'1a2f271d-7fab-4f5f-a89a-e4300686f754'} bound to L3 agent in host dv-cinder-787764-6-iscsi {{(pid=102691) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 18:34:42.024403 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-98314caf-3173-4226-a3ff-9454e9556b3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-787764-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T18:13:36Z,description=,heartbeat_timestamp=2021-11-18T18:34:36Z,host='dv-cinder-787764-6-iscsi',id=389a2729-17ab-41c8-acde-af571e6e3037,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T18:13:36Z,topic='l3_agent')) {'router_ids': ['1a2f271d-7fab-4f5f-a89a-e4300686f754'], 'active': True} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:42.039487 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] For port f86b5f54-d766-4cb3-8202-830d3b24369a, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=f86b5f54-d766-4cb3-8202-830d3b24369a,segment=NetworkSegment(94f1c6ed-c97a-45f3-94c4-d04f9231084d),segment_id=94f1c6ed-c97a-45f3-94c4-d04f9231084d)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:34:42.039860 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.053075 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Calling delete_port for f86b5f54-d766-4cb3-8202-830d3b24369a owned by network:router_gateway {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:34:42.108687 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_dvr_db [None req-98314caf-3173-4226-a3ff-9454e9556b3e None None] Set router 1a2f271d-7fab-4f5f-a89a-e4300686f754 gateway port host: None {{(pid=102691) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 18:34:42.217908 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.244112 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.l3_hamode_db [None req-98314caf-3173-4226-a3ff-9454e9556b3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'name': 'tempest-TestVolumeBootPattern-346410515-router', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:32Z', 'updated_at': '2021-11-18T18:34:41Z', 'revision_number': 6, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'gw_port_host': None}], 'dv-cinder-787764-6-iscsi', False) {} {{(pid=102691) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:42.244561 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Pushing event deleted for resources: {'Port': ['ID=f86b5f54-d766-4cb3-8202-830d3b24369a,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:42.270497 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98314caf-3173-4226-a3ff-9454e9556b3e None None] The sync data for ids ['1a2f271d-7fab-4f5f-a89a-e4300686f754'] in dv-cinder-787764-6-iscsi is: [{'id': '1a2f271d-7fab-4f5f-a89a-e4300686f754', 'name': 'tempest-TestVolumeBootPattern-346410515-router', 'tenant_id': '926cdf1bbb2149b290966b33e1def2c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T18:27:32Z', 'updated_at': '2021-11-18T18:34:41Z', 'revision_number': 6, 'project_id': '926cdf1bbb2149b290966b33e1def2c4', 'gw_port_host': None}] {{(pid=102691) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 18:34:42.310664 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-500475'] for router_gateway, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.399135 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-430336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-557'] for router, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.401250 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.443399 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-430347'] for router, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.443960 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1a2f271d-7fab-4f5f-a89a-e4300686f754 {{(pid=102688) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 18:34:42.448428 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] Publish callbacks [] for router, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.449569 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-bfdd9e78-8562-4fa4-a5d2-cab24502b227 admin admin] 10.222.0.82 "DELETE /v2.0/routers/1a2f271d-7fab-4f5f-a89a-e4300686f754 HTTP/1.1" status: 204 len: 168 time: 0.7525043 Nov 18 18:34:42.452012 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46870) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:42.495557 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.db_base_plugin_v2 [None req-e8de6014-84bb-4eff-8d82-e7f0a40e457a admin admin] Deleting subnet fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2 {{(pid=102688) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 18:34:42.498463 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e8de6014-84bb-4eff-8d82-e7f0a40e457a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.531222 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e8de6014-84bb-4eff-8d82-e7f0a40e457a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14253791'] for subnet, precommit_delete_associations {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.609876 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e8de6014-84bb-4eff-8d82-e7f0a40e457a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-773691'] for subnet, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.670021 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e8de6014-84bb-4eff-8d82-e7f0a40e457a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-773682', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1751088', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-13993132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14505899'] for subnet, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.696994 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8de6014-84bb-4eff-8d82-e7f0a40e457a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:42.700723 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-e8de6014-84bb-4eff-8d82-e7f0a40e457a admin admin] Publish callbacks [] for subnet, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.706997 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-e8de6014-84bb-4eff-8d82-e7f0a40e457a admin admin] 10.222.0.82 "DELETE /v2.0/subnets/fb0729dc-200d-40d4-a2fd-ed0fd58b1cc2 HTTP/1.1" status: 204 len: 168 time: 0.2510178 Nov 18 18:34:42.707169 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44d47c64-3b43-4a31-b18d-6b35acaab38e None None] Network 611bc9f5-d49a-4099-912c-3333772d973c requested from dv-cinder-787764-6-iscsi {{(pid=102690) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 18:34:42.707631 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46872) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:42.785016 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-535496'] for network, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.837105 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Deleting port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 {{(pid=102688) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 18:34:42.837446 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8772714939935'] for port, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.899461 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.db [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] For port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59, host dv-cinder-787764-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787764-6-iscsi',level=0,port_id=9ab0aab0-e172-4507-8e2d-5ac2a6883e59,segment=NetworkSegment(e6aef544-870a-47a3-abc8-6d59806d8d81),segment_id=e6aef544-870a-47a3-abc8-6d59806d8d81)] {{(pid=102688) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 18:34:42.899824 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500821'] for port, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:42.915430 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.plugin [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Calling delete_port for 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 owned by network:dhcp {{(pid=102688) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 18:34:42.991472 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-664654', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-39294', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8772714945805', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8772714603596', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-13993089'] for port, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:43.017949 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Pushing event deleted for resources: {'Port': ['ID=9ab0aab0-e172-4507-8e2d-5ac2a6883e59,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:43.019795 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] No DVR routers for this DVR port 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 on host dv-cinder-787764-6-iscsi {{(pid=102688) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 18:34:43.043186 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-949efbd7-4067-43f2-a85e-a5fbff7d3db3 None None] DHCP port deletion for 611bc9f5-d49a-4099-912c-3333772d973c request from dv-cinder-787764-6-iscsi {{(pid=102690) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 18:34:43.072422 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device f9457714-1f9d-4edc-b7d1-f887e78aae31 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:34:43.097740 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-771970', 'neutron.services.segments.db._delete_segments_for_network-8772714932363'] for network, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:43.097984 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: f9457714-1f9d-4edc-b7d1-f887e78aae31 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:34:43.098099 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device f9457714-1f9d-4edc-b7d1-f887e78aae31 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:34:43.119591 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['611bc9f5-d49a-4099-912c-3333772d973c']}} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:43.130029 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e6aef544-870a-47a3-abc8-6d59806d8d81') {'for_net_delete': True} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:43.130355 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.services.segments.db [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e6aef544-870a-47a3-abc8-6d59806d8d81') {} {{(pid=102688) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 18:34:43.140104 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8772715115843', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14253766'] for segment, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:43.153613 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385'] for segment, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:43.162023 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Releasing vlan 1300 on physical network physnet1 to pool {{(pid=102688) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 18:34:43.162427 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-767385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-13993202'] for segment, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: Traceback (most recent call last): Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: timer() Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: cb(*args, **kw) Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: return func(*args, **kwargs) Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: self._notify() Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: self.callback(batched_events) Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: event.method(event) Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: return f(self, *a, **k) Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._get(url).json() Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: return self.request(url, 'GET', **kwargs) Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 18:34:43.164487 dv-cinder-787764-6-iscsi neutron-server[102688]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 18:34:43.220029 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-772021', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678080', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1772508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-500383'] for network, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:43.227530 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1772334'] for network, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:43.230886 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] 10.222.0.82 "DELETE /v2.0/networks/611bc9f5-d49a-4099-912c-3333772d973c HTTP/1.1" status: 204 len: 168 time: 0.5227849 Nov 18 18:34:43.241016 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e91b0c9-1175-4ae3-887d-6104661095a3 admin admin] Pushing event deleted for resources: {'Network': ['ID=611bc9f5-d49a-4099-912c-3333772d973c,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:43.383953 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46876) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:43.426163 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-9d798464-ac4a-4c92-8661-c7051acffd76 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d08a29a317934e72a71b69340d23cd0b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0410542 Nov 18 18:34:43.428517 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46878) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:43.472685 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b2b30c62-4dcd-41a0-94b3-1543540598c4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:43.495499 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b2b30c62-4dcd-41a0-94b3-1543540598c4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:43.540156 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b2b30c62-4dcd-41a0-94b3-1543540598c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:43.542644 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-b2b30c62-4dcd-41a0-94b3-1543540598c4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:43.543804 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-b2b30c62-4dcd-41a0-94b3-1543540598c4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/14cb5f68-189c-42dc-bf58-26397b735ee6 HTTP/1.1" status: 204 len: 168 time: 0.1143963 Nov 18 18:34:43.552575 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2b30c62-4dcd-41a0-94b3-1543540598c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14cb5f68-189c-42dc-bf58-26397b735ee6,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:43.848349 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46884) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:43.886246 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-fbab0bd3-ae42-4056-b621-16f6bbf21844 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=926cdf1bbb2149b290966b33e1def2c4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0367143 Nov 18 18:34:43.888547 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.wsgi [-] (102688) accepted ('10.222.0.82', 46886) {{(pid=102688) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 18:34:43.933825 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0ddeef06-c79c-4e5a-b37d-6e9f935d9822 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:43.954519 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0ddeef06-c79c-4e5a-b37d-6e9f935d9822 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:44.001808 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0ddeef06-c79c-4e5a-b37d-6e9f935d9822 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1678295'] for security_group, after_delete {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:44.004521 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron_lib.callbacks.manager [None req-0ddeef06-c79c-4e5a-b37d-6e9f935d9822 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102688) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:44.005653 dv-cinder-787764-6-iscsi neutron-server[102688]: INFO neutron.wsgi [None req-0ddeef06-c79c-4e5a-b37d-6e9f935d9822 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3fc7e6dd-4f23-4b01-bda1-c9bfb39faaab HTTP/1.1" status: 204 len: 168 time: 0.1162393 Nov 18 18:34:44.013010 dv-cinder-787764-6-iscsi neutron-server[102688]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddeef06-c79c-4e5a-b37d-6e9f935d9822 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3fc7e6dd-4f23-4b01-bda1-c9bfb39faaab,revision_number=None']} {{(pid=102688) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 18:34:44.610394 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device f86b5f54-d766-4cb3-8202-830d3b24369a no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:34:44.630798 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: f86b5f54-d766-4cb3-8202-830d3b24369a {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:34:44.631146 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device f86b5f54-d766-4cb3-8202-830d3b24369a not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:34:44.631580 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 no longer exists at agent ovs-agent-dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 18:34:44.651487 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.plugin [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] No Port match for: 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 {{(pid=102690) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 18:34:44.651836 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron.plugins.ml2.rpc [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Device 9ab0aab0-e172-4507-8e2d-5ac2a6883e59 not bound to the agent host dv-cinder-787764-6-iscsi {{(pid=102690) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 18:34:51.288106 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:34:56.471432 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:35:04.010151 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e0ee1150-0e60-4763-8e9a-0df2b31a3ab8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:35:06.462398 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-3831ff95-9a3e-408f-85ef-40567e550fb0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:35:07.758356 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:35:09.103034 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:35:10.213928 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:35:21.279257 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:35:33.470848 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:35:34.011500 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-ee59f59f-4c4b-4ece-a1e5-73c0f18e168e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:35:36.463279 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-7d0a05f8-b3a3-419e-ae5e-fa1f51a86e47 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:35:37.762112 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:35:39.105595 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:35:40.215300 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:35:51.277994 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:36:04.012563 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-6e5663bc-46f9-47be-b528-772fb4764db2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:36:06.464048 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-2aa054e3-05ab-417d-a037-be89da3283a3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:36:07.764103 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:36:09.108237 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:36:10.216339 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:36:10.469487 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:36:21.276234 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:36:34.012933 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-5aabff57-88a8-4822-b8b9-95518e11d0b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:36:36.467572 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-94285502-931f-429c-aafd-a4867d7cc124 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:36:37.766197 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:36:39.111905 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:36:40.216864 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:36:47.468328 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:36:51.276279 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:37:04.015011 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-b705b369-1043-426e-8ec9-018457172945 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:37:06.467747 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9bc0f2be-608c-4474-bec3-0b513121ec0a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:37:07.769633 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:37:09.113919 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:37:10.218164 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:37:21.273101 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:37:24.466998 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:37:34.017182 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-4526bf9c-a11c-425c-b1de-7eea00a0c159 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:37:36.468031 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-ed9cdfb1-85a7-4dca-9cec-955690342d28 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:37:37.772093 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:37:39.138580 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:37:40.218989 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:37:51.286098 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:38:01.465667 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:38:04.018202 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-9f1f7c71-777c-47b8-bf33-c812a6641d0f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:38:06.469351 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-f037b4ca-34fa-42e0-95df-0be424882fa2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:38:07.775316 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:38:09.121007 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:38:10.220371 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:38:21.287718 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:38:34.018503 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-b6c6faf0-b561-49fa-b184-3a66e91aee3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:38:36.470593 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-e51b37c0-b318-4148-bd88-cf6363e72fc2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:38:37.777145 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:38:38.464971 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:38:39.124442 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:38:40.221341 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:38:51.284165 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:04.021799 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-399688e3-214b-4f6d-9b22-5d8e14185add None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:06.471225 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-ee0bba7f-e4e7-48ad-be5e-92c982ae3280 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:07.779208 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:09.126046 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:10.223778 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:15.463507 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 18:39:21.298190 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:34.024185 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-a729ffd1-1da3-4e80-913b-e949bfe09238 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:36.471619 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-de3044c5-c74d-47d6-b7a8-23d3d03417d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:37.783370 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-89914ba0-a383-4dd6-93e5-9a18b09eeac2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:39.141578 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-bf7c8d3f-478e-4130-8b56-6a9cac61f17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:40.225924 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-21cdba83-ac40-4cd4-9113-6dcf5487e254 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:51.297183 dv-cinder-787764-6-iscsi neutron-server[102690]: DEBUG neutron_lib.callbacks.manager [None req-111bb4f4-0dc4-4e24-bc33-0d13ef711f89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8772714931860', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-778104'] for agent, after_update {{(pid=102690) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 18:39:52.462063 dv-cinder-787764-6-iscsi neutron-server[102691]: DEBUG neutron.db.agents_db [None req-61baca69-c936-43b4-b92e-5615a383c2d6 None None] Agent healthcheck: found 6 active agents {{(pid=102691) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}